2026-03-28 20:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 20:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 20:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-28 20:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 20:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 20:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 20:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 20:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 20:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 83de5526cf6af4e0
2026-03-28 20:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 20:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-28T20_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 20:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 20:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 20:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 20:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 20:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 20:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 20:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 20:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-28 20:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 20:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 20:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 20:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 20:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 20:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 20:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 20:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 20:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 20:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 20:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 20:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 20:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 20:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 20:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 20:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 20:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 20:30:47 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1094 | hits on page: 40
2026-03-28 20:30:47 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-28 20:30:47 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-28 20:30:47 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 20:30:47 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-28 20:30:47 [auto1.be] INFO: Scrape type for CE14127: 1
2026-03-28 20:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:47 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-28 20:30:47 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-28 20:30:47 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-28 20:30:47 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-28 20:30:47 [auto1.be] INFO: Scrape type for GG74067: 2
2026-03-28 20:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-28 20:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d81d6d19-1ec9-53be-813e-e43f33ce72f3 with scrape type 2
2026-03-28 20:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d81d6d19-1ec9-53be-813e-e43f33ce72f3 with scrape type 2
2026-03-28 20:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d81d6d19-1ec9-53be-813e-e43f33ce72f3, identifier: GG74067
2026-03-28 20:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 20:30:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 20:30:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-28 20:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067 to the API
2026-03-28 20:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:51:36Z',
 'fuel_type': 'petrol',
 'id': 'd81d6d19-1ec9-53be-813e-e43f33ce72f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG74067',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 258823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-21',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2002}
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Saving data for GG74067: {'auction_closing_time': 1774885896.0, 'created_time': 1774524730.657489, 'last_price_update_time': 1774729849.255518}
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG74067') HTTP/1.1" 204 0
2026-03-28 20:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Scrape type for HN37913: 1
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Scrape type for NH43704: 1
2026-03-28 20:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Scrape type for XM15621: 1
2026-03-28 20:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Scrape type for FM14350: 1
2026-03-28 20:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:49 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Scrape type for WL66260: 2
2026-03-28 20:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260
2026-03-28 20:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with scrape type 2
2026-03-28 20:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with scrape type 2
2026-03-28 20:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc, identifier: WL66260
2026-03-28 20:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 20:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260
2026-03-28 20:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260 to the API
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:59:05Z',
 'fuel_type': 'petrol',
 'id': '8a393945-1faf-5eaf-8ffe-42dbeb9e37fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL66260',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 89953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2019}
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-28 20:30:49 [auto1.be] INFO: Saving data for WL66260: {'auction_closing_time': 1774886345.0, 'created_time': 1774038883.617994, 'last_price_update_time': 1774729849.956357}
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL66260') HTTP/1.1" 204 0
2026-03-28 20:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for FY63763: 1
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for CD50133: 2
2026-03-28 20:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133
2026-03-28 20:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21bff88-00bb-56a4-8c83-1c3504b09287 with scrape type 2
2026-03-28 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21bff88-00bb-56a4-8c83-1c3504b09287 with scrape type 2
2026-03-28 20:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d21bff88-00bb-56a4-8c83-1c3504b09287, identifier: CD50133
2026-03-28 20:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 20:30:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133
2026-03-28 20:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133 to the API
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': 'd21bff88-00bb-56a4-8c83-1c3504b09287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD50133',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 205000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-09',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Saving data for CD50133: {'auction_closing_time': 1774885412.0, 'created_time': 1774002047.819883, 'last_price_update_time': 1774729850.689259}
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD50133') HTTP/1.1" 204 0
2026-03-28 20:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for SZ16034: 1
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for FP25504: 1
2026-03-28 20:30:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for BX88810: 1
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-28 20:30:50 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-28 20:30:50 [auto1.be] INFO: Scrape type for EZ00027: 2
2026-03-28 20:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027
2026-03-28 20:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with scrape type 2
2026-03-28 20:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with scrape type 2
2026-03-28 20:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0, identifier: EZ00027
2026-03-28 20:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027
2026-03-28 20:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 20:30:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027
2026-03-28 20:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027 to the API
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:09:03Z',
 'fuel_type': 'diesel',
 'id': '2c56a1ff-25c9-5901-90d0-0b81ecd53dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ00027',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 207990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Saving data for EZ00027: {'auction_closing_time': 1774883343.0, 'created_time': 1774038883.957366, 'last_price_update_time': 1774729851.369645}
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ00027') HTTP/1.1" 204 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for PD85961: 1
2026-03-28 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE14127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN37913/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:51 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1094 | hits on page: 40
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-28 20:30:51 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/CE14127/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-28 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH43704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-28 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-28 20:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM15621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-28 20:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-28 20:30:51 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-28 20:30:51 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM14350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY63763/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD85961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX88810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ16034/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN37913> (referer: https://www.auto1.com/v1/car-details-view/HN37913/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:53 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1094 | hits on page: 40
2026-03-28 20:30:53 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 20:30:53 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [auto1.be] INFO: Scrape type for TX45109: 1
2026-03-28 20:30:53 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [auto1.be] INFO: Scrape type for JD01885: 2
2026-03-28 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-28 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7aadd58-ffec-5042-90af-62accda44cb4 with scrape type 2
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7aadd58-ffec-5042-90af-62accda44cb4 with scrape type 2
2026-03-28 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7aadd58-ffec-5042-90af-62accda44cb4, identifier: JD01885
2026-03-28 20:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-28 20:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-28 20:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885 to the API
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:25Z',
 'fuel_type': 'diesel',
 'id': 'b7aadd58-ffec-5042-90af-62accda44cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD01885',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2016}
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [auto1.be] INFO: Saving data for JD01885: {'auction_closing_time': 1774885645.0, 'created_time': 1774643437.267415, 'last_price_update_time': 1774729853.529394}
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JD01885') HTTP/1.1" 204 0
2026-03-28 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913
2026-03-28 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9324ecf-0440-5388-a2dd-8bad776e6d54 with scrape type 1
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9324ecf-0440-5388-a2dd-8bad776e6d54
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_f8aadde65610d82a8cb28badb1559247.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_f8aadde65610d82a8cb28badb1559247.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_57c17c97efba2363f87c1f7024feb88f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_57c17c97efba2363f87c1f7024feb88f.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_1f8078609273f8750d06da63d98664e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_1f8078609273f8750d06da63d98664e2.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_b3b0405da197f27fa758fb8d5ddd0837.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_b3b0405da197f27fa758fb8d5ddd0837.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_3b41c493fb9d518e8fe266af3d89b34f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_3b41c493fb9d518e8fe266af3d89b34f.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_3a776cdc4f331fe3aa66fd56bfc3c909.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_3a776cdc4f331fe3aa66fd56bfc3c909.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_d039b57f6400199e9b6bbb794185e761.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_d039b57f6400199e9b6bbb794185e761.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_37656e59be10960006188a53af6bc3a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_37656e59be10960006188a53af6bc3a7.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_25f4c7aae9447c42e67bd9b449613e59.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_25f4c7aae9447c42e67bd9b449613e59.jpg already downloaded
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F6a%252Ffd6add5498a668db992e799c7b16ced7%252Fpa%252FHN37913_a83b578ae4c87ac3551c5c2a4c174907.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_a83b578ae4c87ac3551c5c2a4c174907.jpg already downloaded
2026-03-28 20:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9324ecf-0440-5388-a2dd-8bad776e6d54, identifier: HN37913
2026-03-28 20:30:53 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-28 20:30:53 [auto1.be] INFO: Scrape type for GK88228: 2
2026-03-28 20:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-28 20:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with scrape type 2
2026-03-28 20:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with scrape type 2
2026-03-28 20:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53, identifier: GK88228
2026-03-28 20:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913
2026-03-28 20:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913
2026-03-28 20:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913 to the API
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HN37913>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:22Z',
 'fuel_type': 'diesel',
 'id': 'e9324ecf-0440-5388-a2dd-8bad776e6d54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN37913',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'BMW',
 'model': '5er',
 'odometer': 185513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_f8aadde65610d82a8cb28badb1559247.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_57c17c97efba2363f87c1f7024feb88f.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_1f8078609273f8750d06da63d98664e2.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_b3b0405da197f27fa758fb8d5ddd0837.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_3b41c493fb9d518e8fe266af3d89b34f.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_3a776cdc4f331fe3aa66fd56bfc3c909.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_d039b57f6400199e9b6bbb794185e761.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_37656e59be10960006188a53af6bc3a7.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_25f4c7aae9447c42e67bd9b449613e59.jpg',
                'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_a83b578ae4c87ac3551c5c2a4c174907.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_f8aadde65610d82a8cb28badb1559247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3549120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_57c17c97efba2363f87c1f7024feb88f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_1f8078609273f8750d06da63d98664e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3780085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_b3b0405da197f27fa758fb8d5ddd0837.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3614780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_3b41c493fb9d518e8fe266af3d89b34f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3886982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_3a776cdc4f331fe3aa66fd56bfc3c909.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3553701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_d039b57f6400199e9b6bbb794185e761.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3549872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_37656e59be10960006188a53af6bc3a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_25f4c7aae9447c42e67bd9b449613e59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9324ecf-0440-5388-a2dd-8bad776e6d54/e9324ecf-0440-5388-a2dd-8bad776e6d54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3710984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/6a/fd6add5498a668db992e799c7b16ced7/pa/HN37913_a83b578ae4c87ac3551c5c2a4c174907.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-28 20:30:54 [auto1.be] INFO: Saving data for HN37913: {'created_time': 1774729854.402623, 'last_price_update_time': 1774729854.402639, 'auction_closing_time': 1774885462.0}
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HN37913') HTTP/1.1" 204 0
2026-03-28 20:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-28 20:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-28 20:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228 to the API
2026-03-28 20:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'petrol',
 'id': '2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK88228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 161920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-28 20:30:55 [auto1.be] INFO: Saving data for GK88228: {'auction_closing_time': 1774884494.0, 'created_time': 1773390869.438716, 'last_price_update_time': 1774729855.40194}
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GK88228') HTTP/1.1" 204 0
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-28 20:30:55 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-28 20:30:55 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-28 20:30:55 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-28 20:30:55 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 20:30:55 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-28 20:30:55 [auto1.be] INFO: Scrape type for GT11330: 2
2026-03-28 20:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-28 20:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bad3d40-207e-5f55-b53a-295eede7508c with scrape type 2
2026-03-28 20:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bad3d40-207e-5f55-b53a-295eede7508c with scrape type 2
2026-03-28 20:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bad3d40-207e-5f55-b53a-295eede7508c, identifier: GT11330
2026-03-28 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH43704> (referer: https://www.auto1.com/v1/car-details-view/NH43704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM14350> (referer: https://www.auto1.com/v1/car-details-view/FM14350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM15621> (referer: https://www.auto1.com/v1/car-details-view/XM15621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 20:30:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-28 20:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330 to the API
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:18:04Z',
 'fuel_type': 'petrol',
 'id': '0bad3d40-207e-5f55-b53a-295eede7508c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT11330',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 128631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-03',
 'seller_name': None,
 'title': 'Smart forfour 1.5 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2004}
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Saving data for GT11330: {'auction_closing_time': 1774883884.0, 'created_time': 1773226265.57557, 'last_price_update_time': 1774729856.102385}
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GT11330') HTTP/1.1" 204 0
2026-03-28 20:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY63763> (referer: https://www.auto1.com/v1/car-details-view/FY63763/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE14127> (referer: https://www.auto1.com/v1/car-details-view/CE14127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for ZS70359: 2
2026-03-28 20:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-28 20:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7af419-f1a7-5722-b52a-c9af478eeab2 with scrape type 2
2026-03-28 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7af419-f1a7-5722-b52a-c9af478eeab2 with scrape type 2
2026-03-28 20:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b7af419-f1a7-5722-b52a-c9af478eeab2, identifier: ZS70359
2026-03-28 20:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-28 20:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-28 20:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359 to the API
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:33:16Z',
 'fuel_type': 'diesel',
 'id': '1b7af419-f1a7-5722-b52a-c9af478eeab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS70359',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 94593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Premium AWD',
 'transmission': 'automatic',
 'trim': 'Premium AWD',
 'year': 2016}
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Saving data for ZS70359: {'auction_closing_time': 1774884796.0, 'created_time': 1773779669.073823, 'last_price_update_time': 1774729856.782895}
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS70359') HTTP/1.1" 204 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 20:30:56 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-28 20:30:56 [auto1.be] INFO: Scrape type for LK16000: 2
2026-03-28 20:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-28 20:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6489067b-a958-52c0-b402-3218f78f1747 with scrape type 2
2026-03-28 20:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6489067b-a958-52c0-b402-3218f78f1747 with scrape type 2
2026-03-28 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6489067b-a958-52c0-b402-3218f78f1747, identifier: LK16000
2026-03-28 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-28 20:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000 to the API
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:12:42Z',
 'fuel_type': 'petrol',
 'id': '6489067b-a958-52c0-b402-3218f78f1747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK16000',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 94834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-07',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [auto1.be] INFO: Saving data for LK16000: {'auction_closing_time': 1774883562.0, 'created_time': 1774524696.871293, 'last_price_update_time': 1774729857.549484}
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK16000') HTTP/1.1" 204 0
2026-03-28 20:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD85961> (referer: https://www.auto1.com/v1/car-details-view/PD85961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704
2026-03-28 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c164491e-6902-526a-b9d8-8e2ade1f7772 with scrape type 1
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c164491e-6902-526a-b9d8-8e2ade1f7772
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_a3959ea98fc402d3512a80f9d3f3d6bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_a3959ea98fc402d3512a80f9d3f3d6bc.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_ba12d0fea44e398a17254aee9e5f7969.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_ba12d0fea44e398a17254aee9e5f7969.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_c68031ae86fe8ea55004f95725f24d72.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_c68031ae86fe8ea55004f95725f24d72.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_70b9746d76135528286604069ed97b88.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_70b9746d76135528286604069ed97b88.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_5c328ad773083ba5767b6afbd87831d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_5c328ad773083ba5767b6afbd87831d2.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_f14617b2950ff8ebf0462795eb8bae75.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_f14617b2950ff8ebf0462795eb8bae75.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_f0618b65a455f9c356be49ff201217de.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_f0618b65a455f9c356be49ff201217de.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_4e52fccab1cda63442f2dbcd22bbc78a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_4e52fccab1cda63442f2dbcd22bbc78a.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_74a7c474a7826a3f3d0089ac1374ec34.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_74a7c474a7826a3f3d0089ac1374ec34.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F56%252Fe8563b8148e9171060271cef955032f6%252Fpa%252FNH43704_c5c544978dc6267eaa92dc46ee9fb592.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_c5c544978dc6267eaa92dc46ee9fb592.jpg already downloaded
2026-03-28 20:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c164491e-6902-526a-b9d8-8e2ade1f7772, identifier: NH43704
2026-03-28 20:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350
2026-03-28 20:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f40c52f4-51c8-5099-8944-beef9d168590 with scrape type 1
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f40c52f4-51c8-5099-8944-beef9d168590
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_9cd3684d4d42f7c02b2069745ddd4dbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_9cd3684d4d42f7c02b2069745ddd4dbd.jpg already downloaded
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_89c08ac90590d3a12d4d4ab30666fe7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_89c08ac90590d3a12d4d4ab30666fe7f.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_f8712c1ecf585fb0deb52390b10aef35.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_f8712c1ecf585fb0deb52390b10aef35.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_3dd9586f7ccecff8f94fc9da4ab19ab1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_3dd9586f7ccecff8f94fc9da4ab19ab1.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_394e51fe7efc507c026201b8318e3fe4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_394e51fe7efc507c026201b8318e3fe4.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_110f066d1712b1b1c9bc722b716e81a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_110f066d1712b1b1c9bc722b716e81a0.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_aef08c6cb42205582ebad5b8595687ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_aef08c6cb42205582ebad5b8595687ee.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_e97463b0b35bca370076b4d23f7c5134.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_e97463b0b35bca370076b4d23f7c5134.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_b0821690b9c3c3003b44dd4acf7ed397.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_b0821690b9c3c3003b44dd4acf7ed397.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F09%252Fff092827ca102bd36d8732dea2160332%252Fpa%252FFM14350_a08a83bbd029bf9695d3c79ee951e077.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_a08a83bbd029bf9695d3c79ee951e077.jpg already downloaded
2026-03-28 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f40c52f4-51c8-5099-8944-beef9d168590, identifier: FM14350
2026-03-28 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621
2026-03-28 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ff3281-a45f-5620-b4dc-65349ca69ad5 with scrape type 1
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3ff3281-a45f-5620-b4dc-65349ca69ad5
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_810106076e5feab6e39cb99eb11de6c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_810106076e5feab6e39cb99eb11de6c8.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_97110aa5e05071ce704300d77ae532ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_97110aa5e05071ce704300d77ae532ff.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_f48c90afa827f509ca3266672c9f4913.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_f48c90afa827f509ca3266672c9f4913.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_3ace7834c99b781229656ca0c9283dd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_3ace7834c99b781229656ca0c9283dd6.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_2b7f6ea3ad24f8ac49d9d0eac13d8fa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_2b7f6ea3ad24f8ac49d9d0eac13d8fa1.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_0ea271c3f31f10fea0e36144fc8b9304.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_0ea271c3f31f10fea0e36144fc8b9304.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_a379a9d3e7e3723686e3df8d3d04b48f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_a379a9d3e7e3723686e3df8d3d04b48f.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_d0d1d20f8a4b79f2a013e76a49b08d06.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_d0d1d20f8a4b79f2a013e76a49b08d06.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_46391d73f4b1912a16a46fd66831094a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_46391d73f4b1912a16a46fd66831094a.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F2b%252F422b2bf2092871e781013ca1183d4d12%252Fpa%252FXM15621_666e8c9fd1a8461fe149c14028f03205.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_666e8c9fd1a8461fe149c14028f03205.jpg already downloaded
2026-03-28 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3ff3281-a45f-5620-b4dc-65349ca69ad5, identifier: XM15621
2026-03-28 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763
2026-03-28 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0f3674-2922-5e79-8394-cf919c44c6fa with scrape type 1
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f0f3674-2922-5e79-8394-cf919c44c6fa
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_fbdcd4c67ebc4e1fc2621effbba56521.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_fbdcd4c67ebc4e1fc2621effbba56521.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_8acf02317bcdd82de5b13c2f8236af43.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_8acf02317bcdd82de5b13c2f8236af43.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_5feeac1223f4f39a23eb8be763339788.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_5feeac1223f4f39a23eb8be763339788.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_2859d864393ec37b5783fa5b9930b306.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_2859d864393ec37b5783fa5b9930b306.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_29fc0e0f317c443dd6e91b37653bbd2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_29fc0e0f317c443dd6e91b37653bbd2f.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_476bb02573f342b351042464fe7ca18b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_476bb02573f342b351042464fe7ca18b.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_548a411027e6329f909810dc9244f34d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_548a411027e6329f909810dc9244f34d.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_bcaa8e6bfeb8d5b203f0dc11a7eeb74e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_bcaa8e6bfeb8d5b203f0dc11a7eeb74e.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_4f06b24e64af22c9ca95515bf6119d28.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_4f06b24e64af22c9ca95515bf6119d28.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fcd%252Fbacdbea030200e7192c0a3caecae4988%252Fpa%252FFY63763_703467d79ab9a6ef13e913d5fe4e72d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_703467d79ab9a6ef13e913d5fe4e72d6.jpg already downloaded
2026-03-28 20:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f0f3674-2922-5e79-8394-cf919c44c6fa, identifier: FY63763
2026-03-28 20:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127
2026-03-28 20:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de37f07b-ab10-57cd-93e8-2b87d9aeec98 with scrape type 1
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de37f07b-ab10-57cd-93e8-2b87d9aeec98
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_c215d00060bdfdc2c5d8705413dd4bb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c215d00060bdfdc2c5d8705413dd4bb1.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_b7310fa1cd9926fdcd15be812f4d5472.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b7310fa1cd9926fdcd15be812f4d5472.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_b0c79c1d937ae581d53d971e5d282f69.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b0c79c1d937ae581d53d971e5d282f69.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_c866f520b13067bba4316eb7e67005c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c866f520b13067bba4316eb7e67005c1.jpg already downloaded
2026-03-28 20:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_686a412e11e014629c0bb79ee5228c62.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_686a412e11e014629c0bb79ee5228c62.jpg already downloaded
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_b79cd09a760fab949d188775521a1717.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b79cd09a760fab949d188775521a1717.jpg already downloaded
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_90ea7e45b902407d1c64b38c909dafa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_90ea7e45b902407d1c64b38c909dafa1.jpg already downloaded
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_64dff050589c2fc2d378f235d08220d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_64dff050589c2fc2d378f235d08220d0.jpg already downloaded
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_c4a9c8218fc9c40fbd9e65c3788503e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c4a9c8218fc9c40fbd9e65c3788503e3.jpg already downloaded
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F48%252F74485a8f7b08d8ee950acbed0ad579ba%252Fpa%252FCE14127_9cf88d10708431e2aeb310694d1db267.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_9cf88d10708431e2aeb310694d1db267.jpg already downloaded
2026-03-28 20:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de37f07b-ab10-57cd-93e8-2b87d9aeec98, identifier: CE14127
2026-03-28 20:30:59 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 20:30:59 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-28 20:30:59 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 20:30:59 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-28 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704
2026-03-28 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704
2026-03-28 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704 to the API
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NH43704>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'diesel',
 'id': 'c164491e-6902-526a-b9d8-8e2ade1f7772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH43704',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 135789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_a3959ea98fc402d3512a80f9d3f3d6bc.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_ba12d0fea44e398a17254aee9e5f7969.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_c68031ae86fe8ea55004f95725f24d72.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_70b9746d76135528286604069ed97b88.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_5c328ad773083ba5767b6afbd87831d2.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_f14617b2950ff8ebf0462795eb8bae75.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_f0618b65a455f9c356be49ff201217de.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_4e52fccab1cda63442f2dbcd22bbc78a.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_74a7c474a7826a3f3d0089ac1374ec34.jpg',
                'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_c5c544978dc6267eaa92dc46ee9fb592.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_a3959ea98fc402d3512a80f9d3f3d6bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_ba12d0fea44e398a17254aee9e5f7969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_c68031ae86fe8ea55004f95725f24d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_70b9746d76135528286604069ed97b88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_5c328ad773083ba5767b6afbd87831d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_f14617b2950ff8ebf0462795eb8bae75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_f0618b65a455f9c356be49ff201217de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_4e52fccab1cda63442f2dbcd22bbc78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_74a7c474a7826a3f3d0089ac1374ec34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c164491e-6902-526a-b9d8-8e2ade1f7772/c164491e-6902-526a-b9d8-8e2ade1f7772_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/56/e8563b8148e9171060271cef955032f6/pa/NH43704_c5c544978dc6267eaa92dc46ee9fb592.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XE 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2019}
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-28 20:30:59 [auto1.be] INFO: Saving data for NH43704: {'created_time': 1774729859.606087, 'last_price_update_time': 1774729859.606099, 'auction_closing_time': 1774883063.0}
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH43704') HTTP/1.1" 204 0
2026-03-28 20:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350
2026-03-28 20:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350
2026-03-28 20:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350 to the API
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM14350>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:06:46Z',
 'fuel_type': 'petrol',
 'id': 'f40c52f4-51c8-5099-8944-beef9d168590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM14350',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 99721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_9cd3684d4d42f7c02b2069745ddd4dbd.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_89c08ac90590d3a12d4d4ab30666fe7f.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_f8712c1ecf585fb0deb52390b10aef35.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_3dd9586f7ccecff8f94fc9da4ab19ab1.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_394e51fe7efc507c026201b8318e3fe4.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_110f066d1712b1b1c9bc722b716e81a0.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_aef08c6cb42205582ebad5b8595687ee.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_e97463b0b35bca370076b4d23f7c5134.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_b0821690b9c3c3003b44dd4acf7ed397.jpg',
                'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_a08a83bbd029bf9695d3c79ee951e077.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_9cd3684d4d42f7c02b2069745ddd4dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_89c08ac90590d3a12d4d4ab30666fe7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_f8712c1ecf585fb0deb52390b10aef35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_3dd9586f7ccecff8f94fc9da4ab19ab1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_394e51fe7efc507c026201b8318e3fe4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_110f066d1712b1b1c9bc722b716e81a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_aef08c6cb42205582ebad5b8595687ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_e97463b0b35bca370076b4d23f7c5134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_b0821690b9c3c3003b44dd4acf7ed397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f40c52f4-51c8-5099-8944-beef9d168590/f40c52f4-51c8-5099-8944-beef9d168590_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/09/ff092827ca102bd36d8732dea2160332/pa/FM14350_a08a83bbd029bf9695d3c79ee951e077.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 20:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-28 20:31:00 [auto1.be] INFO: Saving data for FM14350: {'created_time': 1774729860.001915, 'last_price_update_time': 1774729860.001927, 'auction_closing_time': 1774883206.0}
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM14350') HTTP/1.1" 204 0
2026-03-28 20:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621
2026-03-28 20:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621
2026-03-28 20:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621 to the API
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XM15621>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:50Z',
 'fuel_type': 'petrol',
 'id': 'c3ff3281-a45f-5620-b4dc-65349ca69ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM15621',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 159447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 38,
 'photo_urls': ['https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_810106076e5feab6e39cb99eb11de6c8.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_97110aa5e05071ce704300d77ae532ff.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_f48c90afa827f509ca3266672c9f4913.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_3ace7834c99b781229656ca0c9283dd6.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_2b7f6ea3ad24f8ac49d9d0eac13d8fa1.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_0ea271c3f31f10fea0e36144fc8b9304.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_a379a9d3e7e3723686e3df8d3d04b48f.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_d0d1d20f8a4b79f2a013e76a49b08d06.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_46391d73f4b1912a16a46fd66831094a.jpg',
                'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_666e8c9fd1a8461fe149c14028f03205.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_810106076e5feab6e39cb99eb11de6c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_97110aa5e05071ce704300d77ae532ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_f48c90afa827f509ca3266672c9f4913.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_3ace7834c99b781229656ca0c9283dd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_2b7f6ea3ad24f8ac49d9d0eac13d8fa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_0ea271c3f31f10fea0e36144fc8b9304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_a379a9d3e7e3723686e3df8d3d04b48f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_d0d1d20f8a4b79f2a013e76a49b08d06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_46391d73f4b1912a16a46fd66831094a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ff3281-a45f-5620-b4dc-65349ca69ad5/c3ff3281-a45f-5620-b4dc-65349ca69ad5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/2b/422b2bf2092871e781013ca1183d4d12/pa/XM15621_666e8c9fd1a8461fe149c14028f03205.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-28 20:31:00 [auto1.be] INFO: Saving data for XM15621: {'created_time': 1774729860.36308, 'last_price_update_time': 1774729860.363093, 'auction_closing_time': 1774885910.0}
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM15621') HTTP/1.1" 204 0
2026-03-28 20:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763
2026-03-28 20:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763
2026-03-28 20:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763 to the API
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FY63763>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:54:43Z',
 'fuel_type': 'diesel',
 'id': '0f0f3674-2922-5e79-8394-cf919c44c6fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY63763',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 61964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_fbdcd4c67ebc4e1fc2621effbba56521.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_8acf02317bcdd82de5b13c2f8236af43.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_5feeac1223f4f39a23eb8be763339788.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_2859d864393ec37b5783fa5b9930b306.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_29fc0e0f317c443dd6e91b37653bbd2f.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_476bb02573f342b351042464fe7ca18b.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_548a411027e6329f909810dc9244f34d.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_bcaa8e6bfeb8d5b203f0dc11a7eeb74e.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_4f06b24e64af22c9ca95515bf6119d28.jpg',
                'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_703467d79ab9a6ef13e913d5fe4e72d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_fbdcd4c67ebc4e1fc2621effbba56521.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_8acf02317bcdd82de5b13c2f8236af43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_5feeac1223f4f39a23eb8be763339788.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_2859d864393ec37b5783fa5b9930b306.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_29fc0e0f317c443dd6e91b37653bbd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_476bb02573f342b351042464fe7ca18b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_548a411027e6329f909810dc9244f34d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_bcaa8e6bfeb8d5b203f0dc11a7eeb74e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_4f06b24e64af22c9ca95515bf6119d28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f0f3674-2922-5e79-8394-cf919c44c6fa/0f0f3674-2922-5e79-8394-cf919c44c6fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/cd/bacdbea030200e7192c0a3caecae4988/pa/FY63763_703467d79ab9a6ef13e913d5fe4e72d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi EcoBlue 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2024}
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-28 20:31:00 [auto1.be] INFO: Saving data for FY63763: {'created_time': 1774729860.688051, 'last_price_update_time': 1774729860.688064, 'auction_closing_time': 1774886083.0}
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY63763') HTTP/1.1" 204 0
2026-03-28 20:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127
2026-03-28 20:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127
2026-03-28 20:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127 to the API
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE14127>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:10Z',
 'fuel_type': 'diesel',
 'id': 'de37f07b-ab10-57cd-93e8-2b87d9aeec98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE14127',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Infiniti',
 'model': 'Q30',
 'odometer': 176169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c215d00060bdfdc2c5d8705413dd4bb1.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b7310fa1cd9926fdcd15be812f4d5472.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b0c79c1d937ae581d53d971e5d282f69.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c866f520b13067bba4316eb7e67005c1.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_686a412e11e014629c0bb79ee5228c62.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b79cd09a760fab949d188775521a1717.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_90ea7e45b902407d1c64b38c909dafa1.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_64dff050589c2fc2d378f235d08220d0.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c4a9c8218fc9c40fbd9e65c3788503e3.jpg',
                'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_9cf88d10708431e2aeb310694d1db267.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c215d00060bdfdc2c5d8705413dd4bb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b7310fa1cd9926fdcd15be812f4d5472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b0c79c1d937ae581d53d971e5d282f69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c866f520b13067bba4316eb7e67005c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_686a412e11e014629c0bb79ee5228c62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_b79cd09a760fab949d188775521a1717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_90ea7e45b902407d1c64b38c909dafa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_64dff050589c2fc2d378f235d08220d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_c4a9c8218fc9c40fbd9e65c3788503e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de37f07b-ab10-57cd-93e8-2b87d9aeec98/de37f07b-ab10-57cd-93e8-2b87d9aeec98_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/48/74485a8f7b08d8ee950acbed0ad579ba/pa/CE14127_9cf88d10708431e2aeb310694d1db267.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Infiniti Q30 1.5 Diesel Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [auto1.be] INFO: Saving data for CE14127: {'created_time': 1774729861.020848, 'last_price_update_time': 1774729861.020859, 'auction_closing_time': 1774885210.0}
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE14127') HTTP/1.1" 204 0
2026-03-28 20:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX88810> (referer: https://www.auto1.com/v1/car-details-view/BX88810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961
2026-03-28 20:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca1d837-7e58-5fe3-ad3b-bf418902878e with scrape type 1
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fca1d837-7e58-5fe3-ad3b-bf418902878e
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_c25402174615d1f6bc16ea78c0ec926f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_c25402174615d1f6bc16ea78c0ec926f.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_4694030acb54fb13f92d4a7a712140dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_4694030acb54fb13f92d4a7a712140dc.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_7fbbbe8478fba6192d1a7e83f46e8864.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_7fbbbe8478fba6192d1a7e83f46e8864.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_b3eb5f2bf045f4746c6ed0d9cb63da23.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_b3eb5f2bf045f4746c6ed0d9cb63da23.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_02c74a876dfe157e42248e5673c29d5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_02c74a876dfe157e42248e5673c29d5f.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_cb44a0ba41dd35db7e1a93acc9384709.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_cb44a0ba41dd35db7e1a93acc9384709.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_cb6d82c01575589be47dfb8cb361e0ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_cb6d82c01575589be47dfb8cb361e0ca.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_95886995b263db56ad9aaad945b17f11.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_95886995b263db56ad9aaad945b17f11.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_4ec0468eef30d77f1c65cbe01938b694.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_4ec0468eef30d77f1c65cbe01938b694.jpg already downloaded
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F05%252F5105322dda05a511314aa58de914aeff%252Fpa%252FPD85961_7b332497b1d345b8e4fb470dc3579765.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_7b332497b1d345b8e4fb470dc3579765.jpg already downloaded
2026-03-28 20:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fca1d837-7e58-5fe3-ad3b-bf418902878e, identifier: PD85961
2026-03-28 20:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961
2026-03-28 20:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961
2026-03-28 20:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961 to the API
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PD85961>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'diesel',
 'id': 'fca1d837-7e58-5fe3-ad3b-bf418902878e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD85961',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 168820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_c25402174615d1f6bc16ea78c0ec926f.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_4694030acb54fb13f92d4a7a712140dc.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_7fbbbe8478fba6192d1a7e83f46e8864.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_b3eb5f2bf045f4746c6ed0d9cb63da23.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_02c74a876dfe157e42248e5673c29d5f.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_cb44a0ba41dd35db7e1a93acc9384709.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_cb6d82c01575589be47dfb8cb361e0ca.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_95886995b263db56ad9aaad945b17f11.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_4ec0468eef30d77f1c65cbe01938b694.jpg',
                'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_7b332497b1d345b8e4fb470dc3579765.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_c25402174615d1f6bc16ea78c0ec926f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_4694030acb54fb13f92d4a7a712140dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_7fbbbe8478fba6192d1a7e83f46e8864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_b3eb5f2bf045f4746c6ed0d9cb63da23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_02c74a876dfe157e42248e5673c29d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_cb44a0ba41dd35db7e1a93acc9384709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_cb6d82c01575589be47dfb8cb361e0ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_95886995b263db56ad9aaad945b17f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_4ec0468eef30d77f1c65cbe01938b694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca1d837-7e58-5fe3-ad3b-bf418902878e/fca1d837-7e58-5fe3-ad3b-bf418902878e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105322dda05a511314aa58de914aeff/pa/PD85961_7b332497b1d345b8e4fb470dc3579765.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2017}
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [auto1.be] INFO: Saving data for PD85961: {'created_time': 1774729861.729906, 'last_price_update_time': 1774729861.729929, 'auction_closing_time': 1774886218.0}
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD85961') HTTP/1.1" 204 0
2026-03-28 20:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810
2026-03-28 20:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with scrape type 1
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_6b65594ab6eda96dfa7643a19a6f1c92.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6b65594ab6eda96dfa7643a19a6f1c92.jpg not downloaded yet
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_e0a791e39c4dfd44460874e8aecd1c7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e0a791e39c4dfd44460874e8aecd1c7a.jpg not downloaded yet
2026-03-28 20:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX45109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_6967b9dcf324f8e6ee4d383987093259.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6967b9dcf324f8e6ee4d383987093259.jpg not downloaded yet
2026-03-28 20:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ16034> (referer: https://www.auto1.com/v1/car-details-view/SZ16034/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_eb1ea274c926d4df3add1a5edcfbaf97.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb1ea274c926d4df3add1a5edcfbaf97.jpg not downloaded yet
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg not downloaded yet
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_eb69a859a2b0d2046a832102b68d0425.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb69a859a2b0d2046a832102b68d0425.jpg not downloaded yet
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_e9c4dd6ee871c6eb01857771fbe88210.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e9c4dd6ee871c6eb01857771fbe88210.jpg not downloaded yet
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_9a662835a2c9b0ab5ae86bf9f18ca570.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_9a662835a2c9b0ab5ae86bf9f18ca570.jpg not downloaded yet
2026-03-28 20:31:01 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_6910ff476800b4329dde754510de2727.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6910ff476800b4329dde754510de2727.jpg not downloaded yet
2026-03-28 20:31:01 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 20:31:01 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 20:31:01 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 20:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-28 20:31:02 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Scrape type for XB95573: 2
2026-03-28 20:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-28 20:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470800c9-f629-52c1-80ba-c4a90acbc99f with scrape type 2
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470800c9-f629-52c1-80ba-c4a90acbc99f with scrape type 2
2026-03-28 20:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 470800c9-f629-52c1-80ba-c4a90acbc99f, identifier: XB95573
2026-03-28 20:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034
2026-03-28 20:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f09987ab-24b8-5363-864a-9fd243afa5e9 with scrape type 1
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f09987ab-24b8-5363-864a-9fd243afa5e9
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_0bf713e3f81c05806fe14993f3a03f64.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_0bf713e3f81c05806fe14993f3a03f64.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_0febeebb5c95554df7050d3fe12beb18.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_0febeebb5c95554df7050d3fe12beb18.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_7e93ffb8f13405a33f7b306ef75cf6c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_7e93ffb8f13405a33f7b306ef75cf6c5.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_274bbfb174498368723bdaa9d0ef1b80.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_274bbfb174498368723bdaa9d0ef1b80.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_07b61de56cd8631081b66e7c5dd30987.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_07b61de56cd8631081b66e7c5dd30987.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_051b05c0515aee01208f5cdfcee4d887.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_051b05c0515aee01208f5cdfcee4d887.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_4b1af756d8dffdfc7bec47ad905196cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_4b1af756d8dffdfc7bec47ad905196cf.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_5648bdc6826183e8e70a3bf675a5bc84.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_5648bdc6826183e8e70a3bf675a5bc84.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_f87f204c74a0380b5b312387344d20e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_f87f204c74a0380b5b312387344d20e2.jpg already downloaded
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F5f%252F0b5fe38550a0099049153609d2f059b2%252Fpa%252FSZ16034_f24985be9a33fbbbf873431c9729feed.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_f24985be9a33fbbbf873431c9729feed.jpg already downloaded
2026-03-28 20:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f09987ab-24b8-5363-864a-9fd243afa5e9, identifier: SZ16034
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_e7947d8bb15958251e9a3a8341fdc842.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e7947d8bb15958251e9a3a8341fdc842.jpg not downloaded yet
2026-03-28 20:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-28 20:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-28 20:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573 to the API
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:04:11Z',
 'fuel_type': 'petrol',
 'id': '470800c9-f629-52c1-80ba-c4a90acbc99f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB95573',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 201001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-28 20:31:02 [auto1.be] INFO: Saving data for XB95573: {'auction_closing_time': 1774883051.0, 'created_time': 1773401489.45726, 'last_price_update_time': 1774729862.909379}
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB95573') HTTP/1.1" 204 0
2026-03-28 20:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034
2026-03-28 20:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034
2026-03-28 20:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034 to the API
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SZ16034>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:21:08Z',
 'fuel_type': 'diesel',
 'id': 'f09987ab-24b8-5363-864a-9fd243afa5e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ16034',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 218325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_0bf713e3f81c05806fe14993f3a03f64.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_0febeebb5c95554df7050d3fe12beb18.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_7e93ffb8f13405a33f7b306ef75cf6c5.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_274bbfb174498368723bdaa9d0ef1b80.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_07b61de56cd8631081b66e7c5dd30987.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_051b05c0515aee01208f5cdfcee4d887.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_4b1af756d8dffdfc7bec47ad905196cf.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_5648bdc6826183e8e70a3bf675a5bc84.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_f87f204c74a0380b5b312387344d20e2.jpg',
                'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_f24985be9a33fbbbf873431c9729feed.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_0bf713e3f81c05806fe14993f3a03f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_0febeebb5c95554df7050d3fe12beb18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_7e93ffb8f13405a33f7b306ef75cf6c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_274bbfb174498368723bdaa9d0ef1b80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_07b61de56cd8631081b66e7c5dd30987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_051b05c0515aee01208f5cdfcee4d887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_4b1af756d8dffdfc7bec47ad905196cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_5648bdc6826183e8e70a3bf675a5bc84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_f87f204c74a0380b5b312387344d20e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f09987ab-24b8-5363-864a-9fd243afa5e9/f09987ab-24b8-5363-864a-9fd243afa5e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/5f/0b5fe38550a0099049153609d2f059b2/pa/SZ16034_f24985be9a33fbbbf873431c9729feed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Saving data for SZ16034: {'created_time': 1774729863.315397, 'last_price_update_time': 1774729863.315407, 'auction_closing_time': 1774884068.0}
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ16034') HTTP/1.1" 204 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for FB34577: 1
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-28 20:31:03 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-28 20:31:03 [auto1.be] INFO: Scrape type for GX61337: 2
2026-03-28 20:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-28 20:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c606a4-debf-5aa0-bac1-8352f14136fc with scrape type 2
2026-03-28 20:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c606a4-debf-5aa0-bac1-8352f14136fc with scrape type 2
2026-03-28 20:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b3c606a4-debf-5aa0-bac1-8352f14136fc, identifier: GX61337
2026-03-28 20:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 20:31:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-28 20:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337 to the API
2026-03-28 20:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:01:43Z',
 'fuel_type': 'petrol',
 'id': 'b3c606a4-debf-5aa0-bac1-8352f14136fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX61337',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 56740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2020}
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-28 20:31:04 [auto1.be] INFO: Saving data for GX61337: {'auction_closing_time': 1774882903.0, 'created_time': 1774524670.979238, 'last_price_update_time': 1774729864.15807}
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX61337') HTTP/1.1" 204 0
2026-03-28 20:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:04 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-28 20:31:04 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-28 20:31:04 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-28 20:31:04 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-28 20:31:04 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb1ea274c926d4df3add1a5edcfbaf97.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e0a791e39c4dfd44460874e8aecd1c7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6967b9dcf324f8e6ee4d383987093259.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6b65594ab6eda96dfa7643a19a6f1c92.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6910ff476800b4329dde754510de2727.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e7947d8bb15958251e9a3a8341fdc842.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731cce50>
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_eb1ea274c926d4df3add1a5edcfbaf97.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb1ea274c926d4df3add1a5edcfbaf97.jpg saved to cache
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731dd790>
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_e0a791e39c4dfd44460874e8aecd1c7a.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e0a791e39c4dfd44460874e8aecd1c7a.jpg saved to cache
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17315e590>
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_6967b9dcf324f8e6ee4d383987093259.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6967b9dcf324f8e6ee4d383987093259.jpg saved to cache
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb69a859a2b0d2046a832102b68d0425.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e9c4dd6ee871c6eb01857771fbe88210.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_9a662835a2c9b0ab5ae86bf9f18ca570.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730062d0>
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_6b65594ab6eda96dfa7643a19a6f1c92.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6b65594ab6eda96dfa7643a19a6f1c92.jpg saved to cache
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e5a50>
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_6910ff476800b4329dde754510de2727.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6910ff476800b4329dde754510de2727.jpg saved to cache
2026-03-28 20:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731a3e50>
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_e7947d8bb15958251e9a3a8341fdc842.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e7947d8bb15958251e9a3a8341fdc842.jpg saved to cache
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730b7090>
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_eb69a859a2b0d2046a832102b68d0425.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb69a859a2b0d2046a832102b68d0425.jpg saved to cache
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730d1990>
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_e9c4dd6ee871c6eb01857771fbe88210.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e9c4dd6ee871c6eb01857771fbe88210.jpg saved to cache
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17329c490>
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_9a662835a2c9b0ab5ae86bf9f18ca570.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_9a662835a2c9b0ab5ae86bf9f18ca570.jpg saved to cache
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bfdd0>
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F8e%252Fef8ea588d7fbac096124a46e26ca32f3%252Fpa%252FBX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg saved to cache
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe
2026-03-28 20:31:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe, skipping ID generation
2026-03-28 20:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with scrape type 1
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe sending to next pipeline
2026-03-28 20:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe, identifier: BX88810
2026-03-28 20:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810
2026-03-28 20:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810
2026-03-28 20:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810 to the API
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:43:40Z',
 'fuel_type': 'diesel',
 'id': 'a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX88810',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 170628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6b65594ab6eda96dfa7643a19a6f1c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e0a791e39c4dfd44460874e8aecd1c7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6967b9dcf324f8e6ee4d383987093259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb1ea274c926d4df3add1a5edcfbaf97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_72cc96ab0a4eb497c3f430a7edce5d4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_eb69a859a2b0d2046a832102b68d0425.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e9c4dd6ee871c6eb01857771fbe88210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_9a662835a2c9b0ab5ae86bf9f18ca570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_6910ff476800b4329dde754510de2727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe/a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/8e/ef8ea588d7fbac096124a46e26ca32f3/pa/BX88810_e7947d8bb15958251e9a3a8341fdc842.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-28 20:31:05 [auto1.be] INFO: Saving data for BX88810: {'created_time': 1774729865.811073, 'last_price_update_time': 1774729865.811086, 'auction_closing_time': 1774885420.0}
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX88810') HTTP/1.1" 204 0
2026-03-28 20:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX45109> (referer: https://www.auto1.com/v1/car-details-view/TX45109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB34577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:05 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:05 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-28 20:31:05 [auto1.be] INFO: Scrape type for EZ55101: 2
2026-03-28 20:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-28 20:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 514e9273-813b-58fb-9c98-e900f39e458d with scrape type 2
2026-03-28 20:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 514e9273-813b-58fb-9c98-e900f39e458d with scrape type 2
2026-03-28 20:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 514e9273-813b-58fb-9c98-e900f39e458d, identifier: EZ55101
2026-03-28 20:31:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-28 20:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-28 20:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101 to the API
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:11:04Z',
 'fuel_type': 'petrol',
 'id': '514e9273-813b-58fb-9c98-e900f39e458d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ55101',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 149041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Saving data for EZ55101: {'auction_closing_time': 1774883464.0, 'created_time': 1773779936.379094, 'last_price_update_time': 1774729866.35063}
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ55101') HTTP/1.1" 204 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-28 20:31:06 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-28 20:31:06 [auto1.be] INFO: Scrape type for TU47744: 2
2026-03-28 20:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-28 20:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7837f19-9d6b-58ca-ab26-796f67095cf9 with scrape type 2
2026-03-28 20:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7837f19-9d6b-58ca-ab26-796f67095cf9 with scrape type 2
2026-03-28 20:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7837f19-9d6b-58ca-ab26-796f67095cf9, identifier: TU47744
2026-03-28 20:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 20:31:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-28 20:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744 to the API
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'diesel',
 'id': 'b7837f19-9d6b-58ca-ab26-796f67095cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU47744',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 228161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2013}
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [auto1.be] INFO: Saving data for TU47744: {'auction_closing_time': 1774885507.0, 'created_time': 1774524684.965676, 'last_price_update_time': 1774729867.26237}
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU47744') HTTP/1.1" 204 0
2026-03-28 20:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109
2026-03-28 20:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f880e35c-93a2-5ccb-9448-eea535ac0528 with scrape type 1
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f880e35c-93a2-5ccb-9448-eea535ac0528
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F68%252F4d68a9965689800868f1a4f61f0c882e%252Fpa%252FTX45109_ebd1692a6eafe863cd64d36cf3955ce5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_ebd1692a6eafe863cd64d36cf3955ce5.jpg already downloaded
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F68%252F4d68a9965689800868f1a4f61f0c882e%252Fpa%252FTX45109_dcfe3069b606cad07d157c835c908de2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_dcfe3069b606cad07d157c835c908de2.jpg already downloaded
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F68%252F4d68a9965689800868f1a4f61f0c882e%252Fpa%252FTX45109_6a70a895b1f31d823120b19a9bc1dc90.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_6a70a895b1f31d823120b19a9bc1dc90.jpg already downloaded
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F68%252F4d68a9965689800868f1a4f61f0c882e%252Fpa%252FTX45109_88aad8fa5e380e5d6b746a9dafaa085e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_88aad8fa5e380e5d6b746a9dafaa085e.jpg already downloaded
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F68%252F4d68a9965689800868f1a4f61f0c882e%252Fpa%252FTX45109_50245e9bbffc09dafdb58997d075adca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_50245e9bbffc09dafdb58997d075adca.jpg already downloaded
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F68%252F4d68a9965689800868f1a4f61f0c882e%252Fpa%252FTX45109_1e2e37d34516931cc0bd5b1c880409d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_1e2e37d34516931cc0bd5b1c880409d3.jpg already downloaded
2026-03-28 20:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f880e35c-93a2-5ccb-9448-eea535ac0528, identifier: TX45109
2026-03-28 20:31:07 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-28 20:31:07 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 20:31:07 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 20:31:07 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-28 20:31:07 [auto1.be] INFO: Scrape type for NG90127: 2
2026-03-28 20:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-28 20:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with scrape type 2
2026-03-28 20:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with scrape type 2
2026-03-28 20:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31, identifier: NG90127
2026-03-28 20:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109
2026-03-28 20:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109
2026-03-28 20:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109 to the API
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX45109>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:42:03Z',
 'fuel_type': 'diesel',
 'id': 'f880e35c-93a2-5ccb-9448-eea535ac0528',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX45109',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 278573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_ebd1692a6eafe863cd64d36cf3955ce5.jpg',
                'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_dcfe3069b606cad07d157c835c908de2.jpg',
                'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_6a70a895b1f31d823120b19a9bc1dc90.jpg',
                'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_88aad8fa5e380e5d6b746a9dafaa085e.jpg',
                'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_50245e9bbffc09dafdb58997d075adca.jpg',
                'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_1e2e37d34516931cc0bd5b1c880409d3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f880e35c-93a2-5ccb-9448-eea535ac0528/f880e35c-93a2-5ccb-9448-eea535ac0528_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_ebd1692a6eafe863cd64d36cf3955ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f880e35c-93a2-5ccb-9448-eea535ac0528/f880e35c-93a2-5ccb-9448-eea535ac0528_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_dcfe3069b606cad07d157c835c908de2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f880e35c-93a2-5ccb-9448-eea535ac0528/f880e35c-93a2-5ccb-9448-eea535ac0528_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_6a70a895b1f31d823120b19a9bc1dc90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f880e35c-93a2-5ccb-9448-eea535ac0528/f880e35c-93a2-5ccb-9448-eea535ac0528_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_88aad8fa5e380e5d6b746a9dafaa085e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f880e35c-93a2-5ccb-9448-eea535ac0528/f880e35c-93a2-5ccb-9448-eea535ac0528_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_50245e9bbffc09dafdb58997d075adca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f880e35c-93a2-5ccb-9448-eea535ac0528/f880e35c-93a2-5ccb-9448-eea535ac0528_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/68/4d68a9965689800868f1a4f61f0c882e/pa/TX45109_1e2e37d34516931cc0bd5b1c880409d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-22',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 e-HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2013}
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-28 20:31:08 [auto1.be] INFO: Saving data for TX45109: {'created_time': 1774729868.051442, 'last_price_update_time': 1774729868.051453, 'auction_closing_time': 1774885323.0}
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX45109') HTTP/1.1" 204 0
2026-03-28 20:31:08 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 29 pages/min), scraped 23 items (at 23 items/min)
2026-03-28 20:31:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-28 20:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-28 20:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-28 20:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127 to the API
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:56Z',
 'fuel_type': 'petrol',
 'id': '689d1450-c91a-59c5-8e6f-f4e9dbc68a31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG90127',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 134234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-28 20:31:08 [auto1.be] INFO: Saving data for NG90127: {'auction_closing_time': 1774886336.0, 'created_time': 1774524669.649977, 'last_price_update_time': 1774729868.381474}
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG90127') HTTP/1.1" 204 0
2026-03-28 20:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:08 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 20:31:08 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 20:31:08 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 20:31:08 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 20:31:08 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-28 20:31:08 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-28 20:31:08 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-28 20:31:08 [auto1.be] INFO: Scrape type for YN02015: 2
2026-03-28 20:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-28 20:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7715cd53-ea1d-5c62-8a22-dd974965764b with scrape type 2
2026-03-28 20:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7715cd53-ea1d-5c62-8a22-dd974965764b with scrape type 2
2026-03-28 20:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7715cd53-ea1d-5c62-8a22-dd974965764b, identifier: YN02015
2026-03-28 20:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 20:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-28 20:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015 to the API
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'hybrid',
 'id': '7715cd53-ea1d-5c62-8a22-dd974965764b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN02015',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 149154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Saving data for YN02015: {'auction_closing_time': 1774885507.0, 'created_time': 1774643431.644295, 'last_price_update_time': 1774729869.037662}
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN02015') HTTP/1.1" 204 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for WV47829: 2
2026-03-28 20:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-28 20:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eadca8bf-3085-55c5-bef2-d61f7a749a42 with scrape type 2
2026-03-28 20:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eadca8bf-3085-55c5-bef2-d61f7a749a42 with scrape type 2
2026-03-28 20:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eadca8bf-3085-55c5-bef2-d61f7a749a42, identifier: WV47829
2026-03-28 20:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-28 20:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-28 20:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829 to the API
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:55Z',
 'fuel_type': 'diesel',
 'id': 'eadca8bf-3085-55c5-bef2-d61f7a749a42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV47829',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 111467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2021}
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Saving data for WV47829: {'auction_closing_time': 1774883995.0, 'created_time': 1773909053.334438, 'last_price_update_time': 1774729869.616679}
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV47829') HTTP/1.1" 204 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-28 20:31:09 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-28 20:31:09 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-28 20:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:10 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:10 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 20:31:10 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-28 20:31:10 [auto1.be] INFO: Scrape type for ND78338: 2
2026-03-28 20:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-28 20:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcfde79d-7732-504a-936f-78c7d505981f with scrape type 2
2026-03-28 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcfde79d-7732-504a-936f-78c7d505981f with scrape type 2
2026-03-28 20:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcfde79d-7732-504a-936f-78c7d505981f, identifier: ND78338
2026-03-28 20:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-28 20:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-28 20:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338 to the API
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:26Z',
 'fuel_type': 'hybrid',
 'id': 'bcfde79d-7732-504a-936f-78c7d505981f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND78338',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 173793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-28 20:31:10 [auto1.be] INFO: Saving data for ND78338: {'auction_closing_time': 1774885106.0, 'created_time': 1773693902.331347, 'last_price_update_time': 1774729870.517074}
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND78338') HTTP/1.1" 204 0
2026-03-28 20:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:10 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 20:31:10 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 20:31:10 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 20:31:10 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-28 20:31:10 [auto1.be] INFO: Scrape type for CS90165: 2
2026-03-28 20:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-28 20:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf424dce-9bd0-590b-8744-14f51e284260 with scrape type 2
2026-03-28 20:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf424dce-9bd0-590b-8744-14f51e284260 with scrape type 2
2026-03-28 20:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf424dce-9bd0-590b-8744-14f51e284260, identifier: CS90165
2026-03-28 20:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-28 20:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-28 20:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165 to the API
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'diesel',
 'id': 'cf424dce-9bd0-590b-8744-14f51e284260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS90165',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 241657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-07',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI clean diesel',
 'transmission': 'manual',
 'trim': 'clean diesel',
 'year': 2015}
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-28 20:31:10 [auto1.be] INFO: Saving data for CS90165: {'auction_closing_time': 1774885320.0, 'created_time': 1774524700.407624, 'last_price_update_time': 1774729870.984534}
2026-03-28 20:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS90165') HTTP/1.1" 204 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for LE58292: 2
2026-03-28 20:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-28 20:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88dec51-e319-5ca0-abb3-23e230e11298 with scrape type 2
2026-03-28 20:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88dec51-e319-5ca0-abb3-23e230e11298 with scrape type 2
2026-03-28 20:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e88dec51-e319-5ca0-abb3-23e230e11298, identifier: LE58292
2026-03-28 20:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-28 20:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-28 20:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292 to the API
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:32:18Z',
 'fuel_type': 'diesel',
 'id': 'e88dec51-e319-5ca0-abb3-23e230e11298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE58292',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 113628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Saving data for LE58292: {'auction_closing_time': 1774884738.0, 'created_time': 1774524704.281292, 'last_price_update_time': 1774729871.786316}
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE58292') HTTP/1.1" 204 0
2026-03-28 20:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB34577> (referer: https://www.auto1.com/v1/car-details-view/FB34577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-28 20:31:11 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 20:31:11 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 20:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [auto1.be] INFO: Scrape type for ZB59407: 2
2026-03-28 20:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-28 20:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with scrape type 2
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with scrape type 2
2026-03-28 20:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3, identifier: ZB59407
2026-03-28 20:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-28 20:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-28 20:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407 to the API
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:21:40Z',
 'fuel_type': 'petrol',
 'id': '82a3ea25-3305-5fd5-9dfa-25983e9f96f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59407',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 102886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-11',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [auto1.be] INFO: Saving data for ZB59407: {'auction_closing_time': 1774884100.0, 'created_time': 1773747683.859757, 'last_price_update_time': 1774729872.437135}
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZB59407') HTTP/1.1" 204 0
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 20:31:12 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-28 20:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577
2026-03-28 20:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7ce98c-f5eb-5145-9733-5bb396206c83 with scrape type 1
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd7ce98c-f5eb-5145-9733-5bb396206c83
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_b66dd4268f667ebed723e93dd63e758b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_b66dd4268f667ebed723e93dd63e758b.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_398afcc32a324e7037ab751a6242728b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_398afcc32a324e7037ab751a6242728b.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_36e5216acca9cfeb962505a995ff10c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_36e5216acca9cfeb962505a995ff10c0.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_796b0714ef6d142f138f70f945e05752.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_796b0714ef6d142f138f70f945e05752.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_5e174ec338289747b37c5d843cc1fa7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_5e174ec338289747b37c5d843cc1fa7c.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_0822958cc37172160632aeda3565a608.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_0822958cc37172160632aeda3565a608.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_aa924c0dac15b8994b74fdc783c53805.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_aa924c0dac15b8994b74fdc783c53805.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_7ef5aba36774e53eaeee0c189606a122.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_7ef5aba36774e53eaeee0c189606a122.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_7f95755db445225819d8342f8a1f12ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_7f95755db445225819d8342f8a1f12ac.jpg already downloaded
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F4b%252Ff44bdf97eacf2265766cf25403ced2a4%252Fpa%252FFB34577_da1e392796e08ab5e8ea5d98386d51fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_da1e392796e08ab5e8ea5d98386d51fa.jpg already downloaded
2026-03-28 20:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd7ce98c-f5eb-5145-9733-5bb396206c83, identifier: FB34577
2026-03-28 20:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577
2026-03-28 20:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577
2026-03-28 20:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577 to the API
2026-03-28 20:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FB34577>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'diesel',
 'id': 'dd7ce98c-f5eb-5145-9733-5bb396206c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB34577',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '1er',
 'odometer': 348563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_b66dd4268f667ebed723e93dd63e758b.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_398afcc32a324e7037ab751a6242728b.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_36e5216acca9cfeb962505a995ff10c0.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_796b0714ef6d142f138f70f945e05752.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_5e174ec338289747b37c5d843cc1fa7c.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_0822958cc37172160632aeda3565a608.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_aa924c0dac15b8994b74fdc783c53805.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_7ef5aba36774e53eaeee0c189606a122.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_7f95755db445225819d8342f8a1f12ac.jpg',
                'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_da1e392796e08ab5e8ea5d98386d51fa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_b66dd4268f667ebed723e93dd63e758b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 430420,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_398afcc32a324e7037ab751a6242728b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_36e5216acca9cfeb962505a995ff10c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289467,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_796b0714ef6d142f138f70f945e05752.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_5e174ec338289747b37c5d843cc1fa7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_0822958cc37172160632aeda3565a608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_aa924c0dac15b8994b74fdc783c53805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_7ef5aba36774e53eaeee0c189606a122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_7f95755db445225819d8342f8a1f12ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7ce98c-f5eb-5145-9733-5bb396206c83/dd7ce98c-f5eb-5145-9733-5bb396206c83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396149,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/4b/f44bdf97eacf2265766cf25403ced2a4/pa/FB34577_da1e392796e08ab5e8ea5d98386d51fa.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Saving data for FB34577: {'created_time': 1774729873.20163, 'last_price_update_time': 1774729873.201642, 'auction_closing_time': 1774886125.0}
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FB34577') HTTP/1.1" 204 0
2026-03-28 20:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:13 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for JK00802: 2
2026-03-28 20:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-28 20:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a115b03-bae1-5659-b73c-a9b56f44c662 with scrape type 2
2026-03-28 20:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a115b03-bae1-5659-b73c-a9b56f44c662 with scrape type 2
2026-03-28 20:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a115b03-bae1-5659-b73c-a9b56f44c662, identifier: JK00802
2026-03-28 20:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-28 20:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-28 20:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802 to the API
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:58:28Z',
 'fuel_type': 'diesel',
 'id': '3a115b03-bae1-5659-b73c-a9b56f44c662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK00802',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 182688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2006}
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Saving data for JK00802: {'auction_closing_time': 1774886308.0, 'created_time': 1774643433.28042, 'last_price_update_time': 1774729873.750144}
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JK00802') HTTP/1.1" 204 0
2026-03-28 20:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 20:31:13 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-28 20:31:13 [auto1.be] INFO: Scrape type for DH81993: 2
2026-03-28 20:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-28 20:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c842aa-bc4f-5da9-a78d-74a263351f67 with scrape type 2
2026-03-28 20:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37c842aa-bc4f-5da9-a78d-74a263351f67 with scrape type 2
2026-03-28 20:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 37c842aa-bc4f-5da9-a78d-74a263351f67, identifier: DH81993
2026-03-28 20:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-28 20:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-28 20:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993 to the API
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:38Z',
 'fuel_type': 'diesel',
 'id': '37c842aa-bc4f-5da9-a78d-74a263351f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH81993',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 164928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2014}
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Saving data for DH81993: {'auction_closing_time': 1774886258.0, 'created_time': 1774557032.149476, 'last_price_update_time': 1774729874.388771}
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH81993') HTTP/1.1" 204 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-28 20:31:14 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-28 20:31:14 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-28 20:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:15 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:15 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-28 20:31:15 [auto1.be] INFO: Scrape type for WE68493: 2
2026-03-28 20:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-28 20:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with scrape type 2
2026-03-28 20:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with scrape type 2
2026-03-28 20:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3, identifier: WE68493
2026-03-28 20:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-28 20:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-28 20:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493 to the API
2026-03-28 20:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:40Z',
 'fuel_type': 'petrol',
 'id': '2d931e28-ca20-5db0-8f32-ebe4c7b3ade3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE68493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 139607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-07',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2014}
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Saving data for WE68493: {'auction_closing_time': 1774885660.0, 'created_time': 1774524698.240862, 'last_price_update_time': 1774729876.030543}
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE68493') HTTP/1.1" 204 0
2026-03-28 20:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 20:31:16 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-28 20:31:16 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-28 20:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:17 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-28 20:31:17 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Scrape type for XR84470: 2
2026-03-28 20:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-28 20:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with scrape type 2
2026-03-28 20:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with scrape type 2
2026-03-28 20:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b, identifier: XR84470
2026-03-28 20:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-28 20:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-28 20:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470 to the API
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': 'dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR84470',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 162715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-12',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2009}
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-28 20:31:17 [auto1.be] INFO: Saving data for XR84470: {'auction_closing_time': 1774885866.0, 'created_time': 1774524703.352459, 'last_price_update_time': 1774729877.972107}
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR84470') HTTP/1.1" 204 0
2026-03-28 20:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:18 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-28 20:31:18 [auto1.be] INFO: Scrape type for FL46625: 2
2026-03-28 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-28 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bd949b-b83e-529a-9f2a-bacf018aaace with scrape type 2
2026-03-28 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4bd949b-b83e-529a-9f2a-bacf018aaace with scrape type 2
2026-03-28 20:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4bd949b-b83e-529a-9f2a-bacf018aaace, identifier: FL46625
2026-03-28 20:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-28 20:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-28 20:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625 to the API
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:28Z',
 'fuel_type': 'diesel',
 'id': 'e4bd949b-b83e-529a-9f2a-bacf018aaace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL46625',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 176922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-16',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-28 20:31:18 [auto1.be] INFO: Saving data for FL46625: {'auction_closing_time': 1774883308.0, 'created_time': 1773909417.812952, 'last_price_update_time': 1774729878.503589}
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL46625') HTTP/1.1" 204 0
2026-03-28 20:31:18 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-28 20:31:18 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-28 20:31:18 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-28 20:31:18 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-28 20:31:18 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-28 20:31:18 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-28 20:31:18 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-28 20:31:18 [auto1.be] INFO: Scrape type for KG19380: 2
2026-03-28 20:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-28 20:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6a1cac-752f-55b3-a2e9-a12e622df169 with scrape type 2
2026-03-28 20:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6a1cac-752f-55b3-a2e9-a12e622df169 with scrape type 2
2026-03-28 20:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc6a1cac-752f-55b3-a2e9-a12e622df169, identifier: KG19380
2026-03-28 20:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-28 20:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-28 20:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380 to the API
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:09:30Z',
 'fuel_type': 'diesel',
 'id': 'bc6a1cac-752f-55b3-a2e9-a12e622df169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG19380',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 33710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-26',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway II',
 'transmission': 'manual',
 'trim': 'Stepway II',
 'year': 2012}
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Saving data for KG19380: {'auction_closing_time': 1774883370.0, 'created_time': 1774557068.228256, 'last_price_update_time': 1774729879.078847}
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG19380') HTTP/1.1" 204 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-28 20:31:19 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 20:31:19 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 20:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:20 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for LL08256: 2
2026-03-28 20:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-28 20:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605abb47-5ccc-5d98-954c-37d2779ff39e with scrape type 2
2026-03-28 20:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605abb47-5ccc-5d98-954c-37d2779ff39e with scrape type 2
2026-03-28 20:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 605abb47-5ccc-5d98-954c-37d2779ff39e, identifier: LL08256
2026-03-28 20:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-28 20:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-28 20:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256 to the API
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:56:25Z',
 'fuel_type': 'petrol',
 'id': '605abb47-5ccc-5d98-954c-37d2779ff39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL08256',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 105113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Saving data for LL08256: {'auction_closing_time': 1774886185.0, 'created_time': 1773236772.964812, 'last_price_update_time': 1774729880.732054}
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LL08256') HTTP/1.1" 204 0
2026-03-28 20:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-28 20:31:20 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 20:31:20 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 20:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-28 20:31:21 [auto1.be] INFO: Scrape type for YW15851: 2
2026-03-28 20:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-28 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with scrape type 2
2026-03-28 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with scrape type 2
2026-03-28 20:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac, identifier: YW15851
2026-03-28 20:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-28 20:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-28 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851 to the API
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:25:28Z',
 'fuel_type': 'diesel',
 'id': '3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW15851',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 97288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 335 L3 BlueHDi 130 Cargo Edition mit '
          'Ladebordwand',
 'transmission': 'manual',
 'trim': '335 L3 BlueHDi 130 Cargo Edition mit Ladebordwand',
 'year': 2017}
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-28 20:31:21 [auto1.be] INFO: Saving data for YW15851: {'auction_closing_time': 1774884328.0, 'created_time': 1774557039.454165, 'last_price_update_time': 1774729881.43294}
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW15851') HTTP/1.1" 204 0
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-28 20:31:21 [auto1.be] INFO: Scrape type for XL26167: 2
2026-03-28 20:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167
2026-03-28 20:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with scrape type 2
2026-03-28 20:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with scrape type 2
2026-03-28 20:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc1f7f23-016e-5c83-89be-1ae807e0a8d4, identifier: XL26167
2026-03-28 20:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167
2026-03-28 20:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167
2026-03-28 20:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167 to the API
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'petrol',
 'id': 'bc1f7f23-016e-5c83-89be-1ae807e0a8d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL26167',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 87470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-21',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-28 20:31:21 [auto1.be] INFO: Saving data for XL26167: {'auction_closing_time': 1774883819.0, 'created_time': 1773348734.831051, 'last_price_update_time': 1774729881.957403}
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL26167') HTTP/1.1" 204 0
2026-03-28 20:31:21 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-28 20:31:21 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-28 20:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP25504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:23 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for MK30308: 2
2026-03-28 20:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-28 20:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a64476-33bd-5625-b0bf-97078fff89b2 with scrape type 2
2026-03-28 20:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a64476-33bd-5625-b0bf-97078fff89b2 with scrape type 2
2026-03-28 20:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65a64476-33bd-5625-b0bf-97078fff89b2, identifier: MK30308
2026-03-28 20:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-28 20:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-28 20:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308 to the API
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:23Z',
 'fuel_type': 'petrol',
 'id': '65a64476-33bd-5625-b0bf-97078fff89b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK30308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 37304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-23',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Saving data for MK30308: {'auction_closing_time': 1774885883.0, 'created_time': 1774643451.803545, 'last_price_update_time': 1774729883.849114}
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK30308') HTTP/1.1" 204 0
2026-03-28 20:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-28 20:31:23 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-28 20:31:23 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for XZ27909: 2
2026-03-28 20:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-28 20:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with scrape type 2
2026-03-28 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with scrape type 2
2026-03-28 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7, identifier: XZ27909
2026-03-28 20:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-28 20:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-28 20:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909 to the API
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'diesel',
 'id': '6ecffe6c-970f-5d77-8ddf-5349f842fdd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ27909',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 213426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Saving data for XZ27909: {'auction_closing_time': 1774883280.0, 'created_time': 1774524673.441385, 'last_price_update_time': 1774729884.552375}
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ27909') HTTP/1.1" 204 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-28 20:31:24 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-28 20:31:24 [auto1.be] INFO: Scrape type for YC48670: 2
2026-03-28 20:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-28 20:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with scrape type 2
2026-03-28 20:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with scrape type 2
2026-03-28 20:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7, identifier: YC48670
2026-03-28 20:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP25504> (referer: https://www.auto1.com/v1/car-details-view/FP25504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-28 20:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-28 20:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670 to the API
2026-03-28 20:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:09Z',
 'fuel_type': 'diesel',
 'id': 'f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC48670',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 134686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-04',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2015}
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Saving data for YC48670: {'auction_closing_time': 1774885689.0, 'created_time': 1773909043.888902, 'last_price_update_time': 1774729885.120619}
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC48670') HTTP/1.1" 204 0
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Scrape type for SX30605: 1
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-28 20:31:25 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-28 20:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504
2026-03-28 20:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with scrape type 1
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_436155ed16d36d1fa209b2efc85954c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_436155ed16d36d1fa209b2efc85954c9.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_b9d7823827a6e0e12cc99b82a20511aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_b9d7823827a6e0e12cc99b82a20511aa.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_2636c6e4fa73196866d526ab51c644c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_2636c6e4fa73196866d526ab51c644c0.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_a0c9620e9d123d9f41ef436bd4cc7a72.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_a0c9620e9d123d9f41ef436bd4cc7a72.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_c743f0130da8e86cf067d32b9c553042.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_c743f0130da8e86cf067d32b9c553042.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_999750dcab561cbccf716377d6882376.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_999750dcab561cbccf716377d6882376.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_4157cc5905811472b80a366e5aa21ee0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_4157cc5905811472b80a366e5aa21ee0.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_ac16f00d57d7857959d0ff2a9e3f4ffc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_ac16f00d57d7857959d0ff2a9e3f4ffc.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_fd87f0b998ade23b6560a3c78fa7ccf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_fd87f0b998ade23b6560a3c78fa7ccf4.jpg already downloaded
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fab%252F92ab0eca67b679c83b7cbb474992d407%252Fpa%252FFP25504_382a9cd81018a9134f658c1fd1b7a486.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_382a9cd81018a9134f658c1fd1b7a486.jpg already downloaded
2026-03-28 20:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7, identifier: FP25504
2026-03-28 20:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504
2026-03-28 20:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504
2026-03-28 20:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504 to the API
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP25504>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:50:50Z',
 'fuel_type': 'petrol',
 'id': '24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP25504',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '4er',
 'odometer': 148752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_436155ed16d36d1fa209b2efc85954c9.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_b9d7823827a6e0e12cc99b82a20511aa.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_2636c6e4fa73196866d526ab51c644c0.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_a0c9620e9d123d9f41ef436bd4cc7a72.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_c743f0130da8e86cf067d32b9c553042.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_999750dcab561cbccf716377d6882376.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_4157cc5905811472b80a366e5aa21ee0.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_ac16f00d57d7857959d0ff2a9e3f4ffc.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_fd87f0b998ade23b6560a3c78fa7ccf4.jpg',
                'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_382a9cd81018a9134f658c1fd1b7a486.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_436155ed16d36d1fa209b2efc85954c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_b9d7823827a6e0e12cc99b82a20511aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_2636c6e4fa73196866d526ab51c644c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_a0c9620e9d123d9f41ef436bd4cc7a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_c743f0130da8e86cf067d32b9c553042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_999750dcab561cbccf716377d6882376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_4157cc5905811472b80a366e5aa21ee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_ac16f00d57d7857959d0ff2a9e3f4ffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_fd87f0b998ade23b6560a3c78fa7ccf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7/24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/ab/92ab0eca67b679c83b7cbb474992d407/pa/FP25504_382a9cd81018a9134f658c1fd1b7a486.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 430i Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-28 20:31:25 [auto1.be] INFO: Saving data for FP25504: {'created_time': 1774729885.879155, 'last_price_update_time': 1774729885.879168, 'auction_closing_time': 1774885850.0}
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP25504') HTTP/1.1" 204 0
2026-03-28 20:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:26 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 20:31:26 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-28 20:31:26 [auto1.be] INFO: Scrape type for MJ77172: 2
2026-03-28 20:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172
2026-03-28 20:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a94e00e-567c-5886-92a5-ac1f83efb459 with scrape type 2
2026-03-28 20:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a94e00e-567c-5886-92a5-ac1f83efb459 with scrape type 2
2026-03-28 20:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a94e00e-567c-5886-92a5-ac1f83efb459, identifier: MJ77172
2026-03-28 20:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172
2026-03-28 20:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172
2026-03-28 20:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172 to the API
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'diesel',
 'id': '7a94e00e-567c-5886-92a5-ac1f83efb459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ77172',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 114574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Saving data for MJ77172: {'auction_closing_time': 1774885242.0, 'created_time': 1773909063.792135, 'last_price_update_time': 1774729887.330919}
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ77172') HTTP/1.1" 204 0
2026-03-28 20:31:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-28 20:31:27 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Scrape type for WE56106: 2
2026-03-28 20:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-28 20:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with scrape type 2
2026-03-28 20:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with scrape type 2
2026-03-28 20:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb, identifier: WE56106
2026-03-28 20:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-28 20:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106
2026-03-28 20:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a9af0a5-cad6-5f58-82c0-94270c54b4fb with identifier: WE56106 to the API
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:54:26Z',
 'fuel_type': 'petrol',
 'id': '4a9af0a5-cad6-5f58-82c0-94270c54b4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE56106',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 153607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-28 20:31:27 [auto1.be] INFO: Saving data for WE56106: {'auction_closing_time': 1774886066.0, 'created_time': 1774524712.791888, 'last_price_update_time': 1774729887.984075}
2026-03-28 20:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE56106') HTTP/1.1" 204 0
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-28 20:31:28 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 20:31:28 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-28 20:31:28 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-28 20:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX30605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:29 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-28 20:31:29 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-28 20:31:29 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-28 20:31:29 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-28 20:31:29 [auto1.be] INFO: Scrape type for ET09366: 2
2026-03-28 20:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-28 20:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with scrape type 2
2026-03-28 20:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with scrape type 2
2026-03-28 20:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6, identifier: ET09366
2026-03-28 20:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-28 20:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-28 20:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366 to the API
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-30T15:20:26Z',
 'fuel_type': 'hybrid',
 'id': '90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET09366',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 52799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-28 20:31:29 [auto1.be] INFO: Saving data for ET09366: {'auction_closing_time': 1774884026.0, 'created_time': 1773833776.671054, 'last_price_update_time': 1774729889.866282}
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET09366') HTTP/1.1" 204 0
2026-03-28 20:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-28 20:31:29 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 20:31:29 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 20:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for UV91092: 2
2026-03-28 20:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-28 20:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with scrape type 2
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with scrape type 2
2026-03-28 20:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 97cef536-caf7-59b1-ab3d-454ec74aa3a7, identifier: UV91092
2026-03-28 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-28 20:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-28 20:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092 to the API
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:07:41Z',
 'fuel_type': 'petrol',
 'id': '97cef536-caf7-59b1-ab3d-454ec74aa3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV91092',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 13399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2021}
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Saving data for UV91092: {'auction_closing_time': 1774883261.0, 'created_time': 1774524703.749716, 'last_price_update_time': 1774729890.459355}
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV91092') HTTP/1.1" 204 0
2026-03-28 20:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX30605> (referer: https://www.auto1.com/v1/car-details-view/SX30605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 20:31:30 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-28 20:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605
2026-03-28 20:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f240d7-1719-5c01-b6f3-18d6515f2b96 with scrape type 1
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16f240d7-1719-5c01-b6f3-18d6515f2b96
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_e1fafa628a7a5afe4399bebe269d8d62.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_e1fafa628a7a5afe4399bebe269d8d62.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_7813d72ac49e88f5b1ebb28003528780.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_7813d72ac49e88f5b1ebb28003528780.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_32cb1c18ce1a8594a09d7dafdd9e914b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_32cb1c18ce1a8594a09d7dafdd9e914b.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_c2711a8b745fdb290ef4073786a410eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_c2711a8b745fdb290ef4073786a410eb.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_2cc5f9360f10a8df68fc69125b56f7d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_2cc5f9360f10a8df68fc69125b56f7d0.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_07e2fb6375adcdec4fa01ad13fb3cfa5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_07e2fb6375adcdec4fa01ad13fb3cfa5.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_30cc90f2424a576f4edc6b101b236c10.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_30cc90f2424a576f4edc6b101b236c10.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_53d90746fd02549c171b9e8344461dc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_53d90746fd02549c171b9e8344461dc3.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_1fb8143862ee38b266b31df110f30196.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_1fb8143862ee38b266b31df110f30196.jpg already downloaded
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85ea63698fba4dd5bb54913e86341d3%252Fpa%252FSX30605_7a51974ed575a998822f95e2ac64b8ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_7a51974ed575a998822f95e2ac64b8ec.jpg already downloaded
2026-03-28 20:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16f240d7-1719-5c01-b6f3-18d6515f2b96, identifier: SX30605
2026-03-28 20:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605
2026-03-28 20:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605
2026-03-28 20:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605 to the API
2026-03-28 20:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX30605>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'diesel',
 'id': '16f240d7-1719-5c01-b6f3-18d6515f2b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX30605',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 160421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_e1fafa628a7a5afe4399bebe269d8d62.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_7813d72ac49e88f5b1ebb28003528780.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_32cb1c18ce1a8594a09d7dafdd9e914b.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_c2711a8b745fdb290ef4073786a410eb.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_2cc5f9360f10a8df68fc69125b56f7d0.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_07e2fb6375adcdec4fa01ad13fb3cfa5.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_30cc90f2424a576f4edc6b101b236c10.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_53d90746fd02549c171b9e8344461dc3.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_1fb8143862ee38b266b31df110f30196.jpg',
                'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_7a51974ed575a998822f95e2ac64b8ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_e1fafa628a7a5afe4399bebe269d8d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_7813d72ac49e88f5b1ebb28003528780.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2353377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_32cb1c18ce1a8594a09d7dafdd9e914b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_c2711a8b745fdb290ef4073786a410eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_2cc5f9360f10a8df68fc69125b56f7d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_07e2fb6375adcdec4fa01ad13fb3cfa5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_30cc90f2424a576f4edc6b101b236c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2194451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_53d90746fd02549c171b9e8344461dc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_1fb8143862ee38b266b31df110f30196.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f240d7-1719-5c01-b6f3-18d6515f2b96/16f240d7-1719-5c01-b6f3-18d6515f2b96_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85ea63698fba4dd5bb54913e86341d3/pa/SX30605_7a51974ed575a998822f95e2ac64b8ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Premium 2WD',
 'transmission': 'automatic',
 'trim': 'Premium 2WD',
 'year': 2019}
2026-03-28 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-28 20:31:31 [auto1.be] INFO: Saving data for SX30605: {'created_time': 1774729891.603916, 'last_price_update_time': 1774729891.603928, 'auction_closing_time': 1774885373.0}
2026-03-28 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX30605') HTTP/1.1" 204 0
2026-03-28 20:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:32 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:32 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 20:31:32 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-28 20:31:32 [auto1.be] INFO: Scrape type for CH83928: 2
2026-03-28 20:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-28 20:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46836ba0-dcc0-5028-a621-e5011f6d3c7b with scrape type 2
2026-03-28 20:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46836ba0-dcc0-5028-a621-e5011f6d3c7b with scrape type 2
2026-03-28 20:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46836ba0-dcc0-5028-a621-e5011f6d3c7b, identifier: CH83928
2026-03-28 20:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-28 20:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:31:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 20:31:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928
2026-03-28 20:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46836ba0-dcc0-5028-a621-e5011f6d3c7b with identifier: CH83928 to the API
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:37:44Z',
 'fuel_type': 'diesel',
 'id': '46836ba0-dcc0-5028-a621-e5011f6d3c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH83928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 165799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2017}
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-28 20:31:33 [auto1.be] INFO: Saving data for CH83928: {'auction_closing_time': 1774885064.0, 'created_time': 1774557029.48714, 'last_price_update_time': 1774729893.43425}
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH83928') HTTP/1.1" 204 0
2026-03-28 20:31:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-28 20:31:33 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-28 20:31:33 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-28 20:31:33 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-28 20:31:33 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-28 20:31:33 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-28 20:31:33 [auto1.be] INFO: Scrape type for XD36076: 2
2026-03-28 20:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-28 20:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d84f2b5-e901-529d-956f-4493e0794e65 with scrape type 2
2026-03-28 20:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d84f2b5-e901-529d-956f-4493e0794e65 with scrape type 2
2026-03-28 20:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d84f2b5-e901-529d-956f-4493e0794e65, identifier: XD36076
2026-03-28 20:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-28 20:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076
2026-03-28 20:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d84f2b5-e901-529d-956f-4493e0794e65 with identifier: XD36076 to the API
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:53Z',
 'fuel_type': 'diesel',
 'id': '6d84f2b5-e901-529d-956f-4493e0794e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD36076',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 170077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Saving data for XD36076: {'auction_closing_time': 1774885013.0, 'created_time': 1773923008.308945, 'last_price_update_time': 1774729894.028524}
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD36076') HTTP/1.1" 204 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for DY95002: 2
2026-03-28 20:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-28 20:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78f06f82-f920-59e5-875b-b7273d1fb069 with scrape type 2
2026-03-28 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78f06f82-f920-59e5-875b-b7273d1fb069 with scrape type 2
2026-03-28 20:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78f06f82-f920-59e5-875b-b7273d1fb069, identifier: DY95002
2026-03-28 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-28 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002
2026-03-28 20:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78f06f82-f920-59e5-875b-b7273d1fb069 with identifier: DY95002 to the API
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:06Z',
 'fuel_type': 'diesel',
 'id': '78f06f82-f920-59e5-875b-b7273d1fb069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY95002',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 220067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-16',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Saving data for DY95002: {'auction_closing_time': 1774885986.0, 'created_time': 1774524731.538607, 'last_price_update_time': 1774729894.697253}
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY95002') HTTP/1.1" 204 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 20:31:34 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-28 20:31:34 [auto1.be] INFO: Scrape type for CE58685: 2
2026-03-28 20:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-28 20:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with scrape type 2
2026-03-28 20:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with scrape type 2
2026-03-28 20:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eb2f681d-d203-57e2-8f7d-18af5a0d45c2, identifier: CE58685
2026-03-28 20:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-28 20:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685
2026-03-28 20:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eb2f681d-d203-57e2-8f7d-18af5a0d45c2 with identifier: CE58685 to the API
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:36:13Z',
 'fuel_type': 'petrol',
 'id': 'eb2f681d-d203-57e2-8f7d-18af5a0d45c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE58685',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 153262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Racer',
 'transmission': 'manual',
 'trim': 'Racer',
 'year': 2016}
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-28 20:31:35 [auto1.be] INFO: Saving data for CE58685: {'auction_closing_time': 1774884973.0, 'created_time': 1773434068.87953, 'last_price_update_time': 1774729895.283974}
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE58685') HTTP/1.1" 204 0
2026-03-28 20:31:35 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-28 20:31:35 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-28 20:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:36 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for CN47453: 2
2026-03-28 20:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-28 20:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with scrape type 2
2026-03-28 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with scrape type 2
2026-03-28 20:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f, identifier: CN47453
2026-03-28 20:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-28 20:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453
2026-03-28 20:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a86a3ac9-a42d-5c78-8c29-4ae09a1de77f with identifier: CN47453 to the API
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:37:15Z',
 'fuel_type': 'diesel',
 'id': 'a86a3ac9-a42d-5c78-8c29-4ae09a1de77f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN47453',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 273890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'BMW 5er 520d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Saving data for CN47453: {'auction_closing_time': 1774885035.0, 'created_time': 1774524725.193731, 'last_price_update_time': 1774729896.720831}
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN47453') HTTP/1.1" 204 0
2026-03-28 20:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 20:31:36 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-28 20:31:36 [auto1.be] INFO: Scrape type for MA06269: 2
2026-03-28 20:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-28 20:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a8844e-4c0a-5673-8d2a-4ca96307810d with scrape type 2
2026-03-28 20:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a8844e-4c0a-5673-8d2a-4ca96307810d with scrape type 2
2026-03-28 20:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1a8844e-4c0a-5673-8d2a-4ca96307810d, identifier: MA06269
2026-03-28 20:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-28 20:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269
2026-03-28 20:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1a8844e-4c0a-5673-8d2a-4ca96307810d with identifier: MA06269 to the API
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:38:42Z',
 'fuel_type': 'diesel',
 'id': 'a1a8844e-4c0a-5673-8d2a-4ca96307810d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA06269',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 157026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2016}
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Saving data for MA06269: {'auction_closing_time': 1774885122.0, 'created_time': 1774524675.546347, 'last_price_update_time': 1774729897.320956}
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA06269') HTTP/1.1" 204 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Scrape type for YU72813: 2
2026-03-28 20:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-28 20:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a76ec79-767d-54a2-9645-fc632314dab7 with scrape type 2
2026-03-28 20:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a76ec79-767d-54a2-9645-fc632314dab7 with scrape type 2
2026-03-28 20:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a76ec79-767d-54a2-9645-fc632314dab7, identifier: YU72813
2026-03-28 20:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-28 20:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813
2026-03-28 20:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a76ec79-767d-54a2-9645-fc632314dab7 with identifier: YU72813 to the API
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:53:21Z',
 'fuel_type': 'diesel',
 'id': '0a76ec79-767d-54a2-9645-fc632314dab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU72813',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 187635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-10',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2018}
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Saving data for YU72813: {'auction_closing_time': 1774886001.0, 'created_time': 1774643479.7543, 'last_price_update_time': 1774729897.809724}
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU72813') HTTP/1.1" 204 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-28 20:31:37 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 20:31:37 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-28 20:31:38 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-28 20:31:38 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-28 20:31:38 [auto1.be] INFO: Scrape type for TW64249: 2
2026-03-28 20:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-28 20:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a35451-5ed2-59ee-991e-149c10f05330 with scrape type 2
2026-03-28 20:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8a35451-5ed2-59ee-991e-149c10f05330 with scrape type 2
2026-03-28 20:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c8a35451-5ed2-59ee-991e-149c10f05330, identifier: TW64249
2026-03-28 20:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-28 20:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249
2026-03-28 20:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c8a35451-5ed2-59ee-991e-149c10f05330 with identifier: TW64249 to the API
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:47:14Z',
 'fuel_type': 'petrol',
 'id': 'c8a35451-5ed2-59ee-991e-149c10f05330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW64249',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 56804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 2WD',
 'transmission': 'manual',
 'trim': '2WD',
 'year': 2019}
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-28 20:31:38 [auto1.be] INFO: Saving data for TW64249: {'auction_closing_time': 1774885634.0, 'created_time': 1774524735.748753, 'last_price_update_time': 1774729898.435427}
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW64249') HTTP/1.1" 204 0
2026-03-28 20:31:38 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-28 20:31:38 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-28 20:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:39 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:39 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 20:31:39 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 20:31:39 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 20:31:39 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-28 20:31:39 [auto1.be] INFO: Scrape type for PY81659: 2
2026-03-28 20:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-28 20:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9597f0e3-fcf9-509d-88fa-2507f6954810 with scrape type 2
2026-03-28 20:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9597f0e3-fcf9-509d-88fa-2507f6954810 with scrape type 2
2026-03-28 20:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9597f0e3-fcf9-509d-88fa-2507f6954810, identifier: PY81659
2026-03-28 20:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-28 20:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659
2026-03-28 20:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9597f0e3-fcf9-509d-88fa-2507f6954810 with identifier: PY81659 to the API
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'diesel',
 'id': '9597f0e3-fcf9-509d-88fa-2507f6954810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY81659',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Saving data for PY81659: {'auction_closing_time': 1774882938.0, 'created_time': 1774557060.829321, 'last_price_update_time': 1774729900.306863}
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PY81659') HTTP/1.1" 204 0
2026-03-28 20:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for RW49064: 2
2026-03-28 20:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-28 20:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb20124-c7a5-5eb9-aeb0-897e67763536 with scrape type 2
2026-03-28 20:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb20124-c7a5-5eb9-aeb0-897e67763536 with scrape type 2
2026-03-28 20:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bb20124-c7a5-5eb9-aeb0-897e67763536, identifier: RW49064
2026-03-28 20:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-28 20:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064
2026-03-28 20:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bb20124-c7a5-5eb9-aeb0-897e67763536 with identifier: RW49064 to the API
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:48:59Z',
 'fuel_type': 'diesel',
 'id': '0bb20124-c7a5-5eb9-aeb0-897e67763536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW49064',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 191150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2018}
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Saving data for RW49064: {'auction_closing_time': 1774885739.0, 'created_time': 1774524698.63406, 'last_price_update_time': 1774729900.788727}
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW49064') HTTP/1.1" 204 0
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for KC69840: 1
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 20:31:40 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-28 20:31:40 [auto1.be] INFO: Scrape type for CS98471: 2
2026-03-28 20:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-28 20:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with scrape type 2
2026-03-28 20:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with scrape type 2
2026-03-28 20:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025, identifier: CS98471
2026-03-28 20:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-28 20:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471
2026-03-28 20:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025 with identifier: CS98471 to the API
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:15:22Z',
 'fuel_type': 'petrol',
 'id': '485ad8ee-fe99-5b0c-8c3a-3ed7d58c9025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS98471',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 126726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.3 DIG-T Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2019}
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Saving data for CS98471: {'auction_closing_time': 1774883722.0, 'created_time': 1774643495.833765, 'last_price_update_time': 1774729901.39828}
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS98471') HTTP/1.1" 204 0
2026-03-28 20:31:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for JZ97752: 1
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-28 20:31:41 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-28 20:31:41 [auto1.be] INFO: Scrape type for SF38570: 2
2026-03-28 20:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-28 20:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bfc384-0b14-5585-a127-339def39987c with scrape type 2
2026-03-28 20:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46bfc384-0b14-5585-a127-339def39987c with scrape type 2
2026-03-28 20:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46bfc384-0b14-5585-a127-339def39987c, identifier: SF38570
2026-03-28 20:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-28 20:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570
2026-03-28 20:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46bfc384-0b14-5585-a127-339def39987c with identifier: SF38570 to the API
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:35Z',
 'fuel_type': 'diesel',
 'id': '46bfc384-0b14-5585-a127-339def39987c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF38570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 196004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Saving data for SF38570: {'auction_closing_time': 1774883675.0, 'created_time': 1774524728.099755, 'last_price_update_time': 1774729902.046278}
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF38570') HTTP/1.1" 204 0
2026-03-28 20:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for PR31064: 2
2026-03-28 20:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-28 20:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with scrape type 2
2026-03-28 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with scrape type 2
2026-03-28 20:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b736c1b1-d83d-5a21-a86f-e1d912abd4a3, identifier: PR31064
2026-03-28 20:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-28 20:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064
2026-03-28 20:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b736c1b1-d83d-5a21-a86f-e1d912abd4a3 with identifier: PR31064 to the API
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:36:01Z',
 'fuel_type': 'diesel',
 'id': 'b736c1b1-d83d-5a21-a86f-e1d912abd4a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR31064',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 148947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-04',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Saving data for PR31064: {'auction_closing_time': 1774884961.0, 'created_time': 1773865879.429227, 'last_price_update_time': 1774729902.614684}
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR31064') HTTP/1.1" 204 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 20:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:42 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 20:31:42 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-28 20:31:42 [auto1.be] INFO: Scrape type for TK06008: 2
2026-03-28 20:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-28 20:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7997474e-e482-5f20-a74c-54252a5a6170 with scrape type 2
2026-03-28 20:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7997474e-e482-5f20-a74c-54252a5a6170 with scrape type 2
2026-03-28 20:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7997474e-e482-5f20-a74c-54252a5a6170, identifier: TK06008
2026-03-28 20:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-28 20:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008
2026-03-28 20:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7997474e-e482-5f20-a74c-54252a5a6170 with identifier: TK06008 to the API
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:42:57Z',
 'fuel_type': 'petrol',
 'id': '7997474e-e482-5f20-a74c-54252a5a6170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK06008',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 58001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Saving data for TK06008: {'auction_closing_time': 1774885377.0, 'created_time': 1774524708.334329, 'last_price_update_time': 1774729903.403429}
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK06008') HTTP/1.1" 204 0
2026-03-28 20:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 20:31:43 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-28 20:31:43 [auto1.be] INFO: Scrape type for HH62001: 2
2026-03-28 20:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-28 20:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e159aa-dfa3-546b-af2c-2d385f022ff5 with scrape type 2
2026-03-28 20:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e159aa-dfa3-546b-af2c-2d385f022ff5 with scrape type 2
2026-03-28 20:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41e159aa-dfa3-546b-af2c-2d385f022ff5, identifier: HH62001
2026-03-28 20:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-28 20:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001
2026-03-28 20:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41e159aa-dfa3-546b-af2c-2d385f022ff5 with identifier: HH62001 to the API
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:06:06Z',
 'fuel_type': 'petrol',
 'id': '41e159aa-dfa3-546b-af2c-2d385f022ff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH62001',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 138606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2007}
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-28 20:31:44 [auto1.be] INFO: Saving data for HH62001: {'auction_closing_time': 1774883166.0, 'created_time': 1774524718.953296, 'last_price_update_time': 1774729904.239318}
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH62001') HTTP/1.1" 204 0
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-28 20:31:44 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-28 20:31:44 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-28 20:31:44 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 20:31:44 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-28 20:31:44 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-28 20:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC69840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ97752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:45 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:45 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-28 20:31:45 [auto1.be] INFO: Scrape type for GA09150: 2
2026-03-28 20:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-28 20:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with scrape type 2
2026-03-28 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with scrape type 2
2026-03-28 20:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474, identifier: GA09150
2026-03-28 20:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-28 20:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150
2026-03-28 20:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcabeb84-ec6b-53b7-bcc8-18dd3bc04474 with identifier: GA09150 to the API
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:17:19Z',
 'fuel_type': 'diesel',
 'id': 'dcabeb84-ec6b-53b7-bcc8-18dd3bc04474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA09150',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 183696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'BMW 3er 325d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-28 20:31:45 [auto1.be] INFO: Saving data for GA09150: {'auction_closing_time': 1774883839.0, 'created_time': 1774524690.959677, 'last_price_update_time': 1774729905.752567}
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA09150') HTTP/1.1" 204 0
2026-03-28 20:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:45 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-28 20:31:45 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-28 20:31:45 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-28 20:31:45 [auto1.be] INFO: Scrape type for JS25395: 2
2026-03-28 20:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-28 20:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c098b5-b634-51ba-b646-fa3203c26975 with scrape type 2
2026-03-28 20:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c098b5-b634-51ba-b646-fa3203c26975 with scrape type 2
2026-03-28 20:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96c098b5-b634-51ba-b646-fa3203c26975, identifier: JS25395
2026-03-28 20:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-28 20:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395
2026-03-28 20:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96c098b5-b634-51ba-b646-fa3203c26975 with identifier: JS25395 to the API
2026-03-28 20:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:10Z',
 'fuel_type': 'diesel',
 'id': '96c098b5-b634-51ba-b646-fa3203c26975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS25395',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 91291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-28 20:31:46 [auto1.be] INFO: Saving data for JS25395: {'auction_closing_time': 1774885510.0, 'created_time': 1774524684.154196, 'last_price_update_time': 1774729906.219559}
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS25395') HTTP/1.1" 204 0
2026-03-28 20:31:46 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 20:31:46 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 20:31:46 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-28 20:31:46 [auto1.be] INFO: Scrape type for FY43318: 2
2026-03-28 20:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-28 20:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cca6974-2926-5b82-9783-98b83b9e5a21 with scrape type 2
2026-03-28 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cca6974-2926-5b82-9783-98b83b9e5a21 with scrape type 2
2026-03-28 20:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0cca6974-2926-5b82-9783-98b83b9e5a21, identifier: FY43318
2026-03-28 20:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 20:31:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318
2026-03-28 20:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0cca6974-2926-5b82-9783-98b83b9e5a21 with identifier: FY43318 to the API
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'petrol',
 'id': '0cca6974-2926-5b82-9783-98b83b9e5a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY43318',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 137116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-28 20:31:46 [auto1.be] INFO: Saving data for FY43318: {'auction_closing_time': 1774883765.0, 'created_time': 1774524688.848057, 'last_price_update_time': 1774729906.847849}
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY43318') HTTP/1.1" 204 0
2026-03-28 20:31:46 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-28 20:31:46 [auto1.be] INFO: Scrape type for FR80699: 2
2026-03-28 20:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-28 20:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051c5500-5793-52b9-9ba2-05d30f6ce70a with scrape type 2
2026-03-28 20:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 051c5500-5793-52b9-9ba2-05d30f6ce70a with scrape type 2
2026-03-28 20:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 051c5500-5793-52b9-9ba2-05d30f6ce70a, identifier: FR80699
2026-03-28 20:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-28 20:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699
2026-03-28 20:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 051c5500-5793-52b9-9ba2-05d30f6ce70a with identifier: FR80699 to the API
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:38:14Z',
 'fuel_type': 'diesel',
 'id': '051c5500-5793-52b9-9ba2-05d30f6ce70a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR80699',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 166229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Saving data for FR80699: {'auction_closing_time': 1774885094.0, 'created_time': 1774524709.855569, 'last_price_update_time': 1774729907.370985}
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR80699') HTTP/1.1" 204 0
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 20:31:47 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Scrape type for EX63844: 2
2026-03-28 20:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-28 20:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e894fc-13c8-5b66-8f67-1e74190f7c30 with scrape type 2
2026-03-28 20:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e894fc-13c8-5b66-8f67-1e74190f7c30 with scrape type 2
2026-03-28 20:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4e894fc-13c8-5b66-8f67-1e74190f7c30, identifier: EX63844
2026-03-28 20:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-28 20:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844
2026-03-28 20:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4e894fc-13c8-5b66-8f67-1e74190f7c30 with identifier: EX63844 to the API
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:12:12Z',
 'fuel_type': 'diesel',
 'id': 'f4e894fc-13c8-5b66-8f67-1e74190f7c30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX63844',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 129189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2019}
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-28 20:31:47 [auto1.be] INFO: Saving data for EX63844: {'auction_closing_time': 1774883532.0, 'created_time': 1774557063.948719, 'last_price_update_time': 1774729907.948908}
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX63844') HTTP/1.1" 204 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for VA07887: 2
2026-03-28 20:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-28 20:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with scrape type 2
2026-03-28 20:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with scrape type 2
2026-03-28 20:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7, identifier: VA07887
2026-03-28 20:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-28 20:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887
2026-03-28 20:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7 with identifier: VA07887 to the API
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:23Z',
 'fuel_type': 'petrol',
 'id': '5904ab3d-3f1b-5bfd-8430-ba6a1f6b4fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA07887',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 60381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Longitude 4x2',
 'transmission': 'automatic',
 'trim': 'Longitude 4x2',
 'year': 2020}
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Saving data for VA07887: {'auction_closing_time': 1774885883.0, 'created_time': 1774524717.848679, 'last_price_update_time': 1774729908.490034}
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA07887') HTTP/1.1" 204 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 20:31:48 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-28 20:31:48 [auto1.be] INFO: Scrape type for TX85632: 2
2026-03-28 20:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-28 20:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e17219-8ea2-5bf3-a798-8eb189081cf9 with scrape type 2
2026-03-28 20:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e17219-8ea2-5bf3-a798-8eb189081cf9 with scrape type 2
2026-03-28 20:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f7e17219-8ea2-5bf3-a798-8eb189081cf9, identifier: TX85632
2026-03-28 20:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-28 20:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632
2026-03-28 20:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f7e17219-8ea2-5bf3-a798-8eb189081cf9 with identifier: TX85632 to the API
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:26Z',
 'fuel_type': 'petrol',
 'id': 'f7e17219-8ea2-5bf3-a798-8eb189081cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX85632',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 66001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-28 20:31:49 [auto1.be] INFO: Saving data for TX85632: {'auction_closing_time': 1774884626.0, 'created_time': 1774524732.510847, 'last_price_update_time': 1774729909.059044}
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX85632') HTTP/1.1" 204 0
2026-03-28 20:31:49 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 20:31:49 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-28 20:31:49 [auto1.be] INFO: Scrape type for CH34151: 2
2026-03-28 20:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-28 20:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with scrape type 2
2026-03-28 20:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with scrape type 2
2026-03-28 20:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b, identifier: CH34151
2026-03-28 20:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-28 20:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151
2026-03-28 20:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f3ae0ec-f66b-5559-8522-f87fcf855c7b with identifier: CH34151 to the API
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:05:45Z',
 'fuel_type': 'petrol',
 'id': '2f3ae0ec-f66b-5559-8522-f87fcf855c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH34151',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 57622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2020}
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-28 20:31:49 [auto1.be] INFO: Saving data for CH34151: {'auction_closing_time': 1774883145.0, 'created_time': 1774524723.962299, 'last_price_update_time': 1774729909.628401}
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH34151') HTTP/1.1" 204 0
2026-03-28 20:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC69840> (referer: https://www.auto1.com/v1/car-details-view/KC69840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ97752> (referer: https://www.auto1.com/v1/car-details-view/JZ97752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:49 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-28 20:31:49 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-28 20:31:49 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-28 20:31:49 [auto1.be] INFO: Scrape type for DM43787: 2
2026-03-28 20:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-28 20:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31db4384-c889-5b5f-b915-6a34124f01b1 with scrape type 2
2026-03-28 20:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31db4384-c889-5b5f-b915-6a34124f01b1 with scrape type 2
2026-03-28 20:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31db4384-c889-5b5f-b915-6a34124f01b1, identifier: DM43787
2026-03-28 20:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-28 20:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787
2026-03-28 20:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31db4384-c889-5b5f-b915-6a34124f01b1 with identifier: DM43787 to the API
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:32:37Z',
 'fuel_type': 'hybrid',
 'id': '31db4384-c889-5b5f-b915-6a34124f01b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM43787',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 88783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Saving data for DM43787: {'auction_closing_time': 1774884757.0, 'created_time': 1774524697.362488, 'last_price_update_time': 1774729910.082351}
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM43787') HTTP/1.1" 204 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 20:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840
2026-03-28 20:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with scrape type 1
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_ec554cef6051791e3d835551fcdef0a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_ec554cef6051791e3d835551fcdef0a9.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_528bf2f065c4cb305ee39409ebae3a40.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_528bf2f065c4cb305ee39409ebae3a40.jpg not downloaded yet
2026-03-28 20:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752
2026-03-28 20:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8252f8-9f3b-5247-944c-414b3e47d28d with scrape type 1
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba8252f8-9f3b-5247-944c-414b3e47d28d
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_c40a0247bee6fdb61f62bee495eff254.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_c40a0247bee6fdb61f62bee495eff254.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_94141dece8477be1cc422bd0e543937f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_94141dece8477be1cc422bd0e543937f.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_c5132e7e3b3ef9ed7e9f0d80800163ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_c5132e7e3b3ef9ed7e9f0d80800163ad.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_79f9b41ed0a49074d322df28e5919864.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_79f9b41ed0a49074d322df28e5919864.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_1134d6dc1e1236415aacb1aa18a3bdad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_1134d6dc1e1236415aacb1aa18a3bdad.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_f68672fe7d2ee49d4544ebf40d25c954.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_f68672fe7d2ee49d4544ebf40d25c954.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_1507eb823ded82406dbe8aec36d81cef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_1507eb823ded82406dbe8aec36d81cef.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_4c4a0f0e69e9583bb7cc1b548be377b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_4c4a0f0e69e9583bb7cc1b548be377b4.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_8337cd8eb2b168704b1aa8dd2792cdd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_8337cd8eb2b168704b1aa8dd2792cdd0.jpg already downloaded
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff6%252F6df6236b36d81227b0d00275b1c8098f%252Fpa%252FJZ97752_d6c8741d1194f482059fe2ab417b5cf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_d6c8741d1194f482059fe2ab417b5cf0.jpg already downloaded
2026-03-28 20:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba8252f8-9f3b-5247-944c-414b3e47d28d, identifier: JZ97752
2026-03-28 20:31:50 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752
2026-03-28 20:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752
2026-03-28 20:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba8252f8-9f3b-5247-944c-414b3e47d28d with identifier: JZ97752 to the API
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ97752>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:52Z',
 'fuel_type': 'petrol',
 'id': 'ba8252f8-9f3b-5247-944c-414b3e47d28d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ97752',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 65118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_c40a0247bee6fdb61f62bee495eff254.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_94141dece8477be1cc422bd0e543937f.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_c5132e7e3b3ef9ed7e9f0d80800163ad.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_79f9b41ed0a49074d322df28e5919864.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_1134d6dc1e1236415aacb1aa18a3bdad.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_f68672fe7d2ee49d4544ebf40d25c954.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_1507eb823ded82406dbe8aec36d81cef.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_4c4a0f0e69e9583bb7cc1b548be377b4.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_8337cd8eb2b168704b1aa8dd2792cdd0.jpg',
                'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_d6c8741d1194f482059fe2ab417b5cf0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_c40a0247bee6fdb61f62bee495eff254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_94141dece8477be1cc422bd0e543937f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_c5132e7e3b3ef9ed7e9f0d80800163ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_79f9b41ed0a49074d322df28e5919864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_1134d6dc1e1236415aacb1aa18a3bdad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_f68672fe7d2ee49d4544ebf40d25c954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_1507eb823ded82406dbe8aec36d81cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_4c4a0f0e69e9583bb7cc1b548be377b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_8337cd8eb2b168704b1aa8dd2792cdd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8252f8-9f3b-5247-944c-414b3e47d28d/ba8252f8-9f3b-5247-944c-414b3e47d28d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f6/6df6236b36d81227b0d00275b1c8098f/pa/JZ97752_d6c8741d1194f482059fe2ab417b5cf0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Saving data for JZ97752: {'created_time': 1774729910.810096, 'last_price_update_time': 1774729910.810112, 'auction_closing_time': 1774882912.0}
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ97752') HTTP/1.1" 204 0
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_d9409b581142038975f7dd510640b90a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d9409b581142038975f7dd510640b90a.jpg not downloaded yet
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-28 20:31:50 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-28 20:31:50 [auto1.be] INFO: Scrape type for BK01349: 2
2026-03-28 20:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-28 20:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with scrape type 2
2026-03-28 20:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with scrape type 2
2026-03-28 20:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934, identifier: BK01349
2026-03-28 20:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-28 20:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349
2026-03-28 20:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2ec4fbc-5d35-5fe3-b628-1228b4b3d934 with identifier: BK01349 to the API
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:08Z',
 'fuel_type': 'petrol',
 'id': 'f2ec4fbc-5d35-5fe3-b628-1228b4b3d934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK01349',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 22103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2022}
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-28 20:31:51 [auto1.be] INFO: Saving data for BK01349: {'auction_closing_time': 1774884428.0, 'created_time': 1774524676.159891, 'last_price_update_time': 1774729911.468597}
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BK01349') HTTP/1.1" 204 0
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_d1086c770b45773546d817fd24a9997b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d1086c770b45773546d817fd24a9997b.jpg not downloaded yet
2026-03-28 20:31:51 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-28 20:31:51 [auto1.be] INFO: Scrape type for BA37972: 2
2026-03-28 20:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-28 20:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed1cb58-a86a-5424-a984-2ac5d160db97 with scrape type 2
2026-03-28 20:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ed1cb58-a86a-5424-a984-2ac5d160db97 with scrape type 2
2026-03-28 20:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ed1cb58-a86a-5424-a984-2ac5d160db97, identifier: BA37972
2026-03-28 20:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-28 20:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972
2026-03-28 20:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ed1cb58-a86a-5424-a984-2ac5d160db97 with identifier: BA37972 to the API
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': '4ed1cb58-a86a-5424-a984-2ac5d160db97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA37972',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara',
 'odometer': 66980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-04',
 'seller_name': None,
 'title': 'Citroen Xsara 1.4 Millesime',
 'transmission': 'manual',
 'trim': 'Millesime',
 'year': 2001}
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Saving data for BA37972: {'auction_closing_time': 1774884913.0, 'created_time': 1773922616.315566, 'last_price_update_time': 1774729912.029027}
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA37972') HTTP/1.1" 204 0
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_c20807bdaaa617f3bf5435811e272dd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_c20807bdaaa617f3bf5435811e272dd1.jpg not downloaded yet
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for TW09601: 2
2026-03-28 20:31:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-28 20:31:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692d14de-a005-5420-90ce-56cf238963bc with scrape type 2
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 692d14de-a005-5420-90ce-56cf238963bc with scrape type 2
2026-03-28 20:31:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 692d14de-a005-5420-90ce-56cf238963bc, identifier: TW09601
2026-03-28 20:31:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-28 20:31:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601
2026-03-28 20:31:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 692d14de-a005-5420-90ce-56cf238963bc with identifier: TW09601 to the API
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:42:09Z',
 'fuel_type': 'diesel',
 'id': '692d14de-a005-5420-90ce-56cf238963bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW09601',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 182252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Saving data for TW09601: {'auction_closing_time': 1774885329.0, 'created_time': 1774557030.384689, 'last_price_update_time': 1774729912.489063}
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW09601') HTTP/1.1" 204 0
2026-03-28 20:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_528bf2f065c4cb305ee39409ebae3a40.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_cfbaf0ce638ccab2ada38443cfc41cb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_cfbaf0ce638ccab2ada38443cfc41cb0.jpg not downloaded yet
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 20:31:52 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-28 20:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d9409b581142038975f7dd510640b90a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d1086c770b45773546d817fd24a9997b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_86d320988695fe0d92eeb4b8a5ce48c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_86d320988695fe0d92eeb4b8a5ce48c6.jpg not downloaded yet
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173293e10>
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_528bf2f065c4cb305ee39409ebae3a40.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_528bf2f065c4cb305ee39409ebae3a40.jpg saved to cache
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_0cee881cb843e0d47f72efeb38645523.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_0cee881cb843e0d47f72efeb38645523.jpg already downloaded
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_29cd047eba314cc46e111eb71f9a5cdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_29cd047eba314cc46e111eb71f9a5cdc.jpg not downloaded yet
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:31:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg not downloaded yet
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173010210>
2026-03-28 20:31:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_d9409b581142038975f7dd510640b90a.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d9409b581142038975f7dd510640b90a.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17315fb50>
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_d1086c770b45773546d817fd24a9997b.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d1086c770b45773546d817fd24a9997b.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_c20807bdaaa617f3bf5435811e272dd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_cfbaf0ce638ccab2ada38443cfc41cb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_29cd047eba314cc46e111eb71f9a5cdc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_86d320988695fe0d92eeb4b8a5ce48c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173088e50>
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_c20807bdaaa617f3bf5435811e272dd1.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_c20807bdaaa617f3bf5435811e272dd1.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17941a1d0>
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_cfbaf0ce638ccab2ada38443cfc41cb0.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_cfbaf0ce638ccab2ada38443cfc41cb0.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173031990>
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_29cd047eba314cc46e111eb71f9a5cdc.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_29cd047eba314cc46e111eb71f9a5cdc.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179156850>
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_86d320988695fe0d92eeb4b8a5ce48c6.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_86d320988695fe0d92eeb4b8a5ce48c6.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173033ad0>
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:31:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F2a%252Fbc2aed8f20bd5cf43147fd4ce128bc5c%252Fpa%252FKC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg') HTTP/1.1" 204 0
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg saved to cache
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8
2026-03-28 20:31:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8, skipping ID generation
2026-03-28 20:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with scrape type 1
2026-03-28 20:31:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 sending to next pipeline
2026-03-28 20:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8, identifier: KC69840
2026-03-28 20:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840
2026-03-28 20:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840
2026-03-28 20:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840 to the API
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:23:48Z',
 'fuel_type': 'diesel',
 'id': '0ba48af8-4b2c-5062-b7f4-c04ca8d928a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC69840',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 184047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_ec554cef6051791e3d835551fcdef0a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_528bf2f065c4cb305ee39409ebae3a40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d9409b581142038975f7dd510640b90a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_d1086c770b45773546d817fd24a9997b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_c20807bdaaa617f3bf5435811e272dd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_cfbaf0ce638ccab2ada38443cfc41cb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_86d320988695fe0d92eeb4b8a5ce48c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_0cee881cb843e0d47f72efeb38645523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_29cd047eba314cc46e111eb71f9a5cdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ba48af8-4b2c-5062-b7f4-c04ca8d928a8/0ba48af8-4b2c-5062-b7f4-c04ca8d928a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/2a/bc2aed8f20bd5cf43147fd4ce128bc5c/pa/KC69840_aaede2ee9f71c2c9d374506dca6c14f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-28 20:31:53 [auto1.be] INFO: Saving data for KC69840: {'created_time': 1774729913.865339, 'last_price_update_time': 1774729913.865351, 'auction_closing_time': 1774884228.0}
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC69840') HTTP/1.1" 204 0
2026-03-28 20:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:54 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for MK20825: 2
2026-03-28 20:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-28 20:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9060c77e-58a0-56e4-a70f-65ffc708ff7a with scrape type 2
2026-03-28 20:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9060c77e-58a0-56e4-a70f-65ffc708ff7a with scrape type 2
2026-03-28 20:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9060c77e-58a0-56e4-a70f-65ffc708ff7a, identifier: MK20825
2026-03-28 20:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-28 20:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825
2026-03-28 20:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9060c77e-58a0-56e4-a70f-65ffc708ff7a with identifier: MK20825 to the API
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '9060c77e-58a0-56e4-a70f-65ffc708ff7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK20825',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 184750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-04-20',
 'seller_name': None,
 'title': 'Lancia Delta 1.9 Turbodiesel TD LS',
 'transmission': 'manual',
 'trim': 'TD LS',
 'year': 1999}
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Saving data for MK20825: {'auction_closing_time': 1774884037.0, 'created_time': 1773237091.551978, 'last_price_update_time': 1774729914.676428}
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK20825') HTTP/1.1" 204 0
2026-03-28 20:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:54 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-28 20:31:54 [auto1.be] INFO: Scrape type for YS48127: 2
2026-03-28 20:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-28 20:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ee751d-f055-5e28-95a6-64d8df2ac6be with scrape type 2
2026-03-28 20:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ee751d-f055-5e28-95a6-64d8df2ac6be with scrape type 2
2026-03-28 20:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6ee751d-f055-5e28-95a6-64d8df2ac6be, identifier: YS48127
2026-03-28 20:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-28 20:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127
2026-03-28 20:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6ee751d-f055-5e28-95a6-64d8df2ac6be with identifier: YS48127 to the API
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:15:41Z',
 'fuel_type': 'petrol',
 'id': 'f6ee751d-f055-5e28-95a6-64d8df2ac6be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS48127',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 117688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Saving data for YS48127: {'auction_closing_time': 1774883741.0, 'created_time': 1774557038.688555, 'last_price_update_time': 1774729915.270482}
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS48127') HTTP/1.1" 204 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for ZC67013: 2
2026-03-28 20:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-28 20:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with scrape type 2
2026-03-28 20:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with scrape type 2
2026-03-28 20:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4, identifier: ZC67013
2026-03-28 20:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-28 20:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013
2026-03-28 20:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4 with identifier: ZC67013 to the API
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:01Z',
 'fuel_type': 'diesel',
 'id': '5b7b3dab-37fe-59e7-9ebd-ddfc750f55d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC67013',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 233200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Saving data for ZC67013: {'auction_closing_time': 1774882801.0, 'created_time': 1774254677.819703, 'last_price_update_time': 1774729915.775105}
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC67013') HTTP/1.1" 204 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-28 20:31:55 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-28 20:31:55 [auto1.be] INFO: Scrape type for UN77217: 2
2026-03-28 20:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-28 20:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5b5348-5b73-5def-863b-43c052e63e32 with scrape type 2
2026-03-28 20:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5b5348-5b73-5def-863b-43c052e63e32 with scrape type 2
2026-03-28 20:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0e5b5348-5b73-5def-863b-43c052e63e32, identifier: UN77217
2026-03-28 20:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-28 20:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217
2026-03-28 20:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0e5b5348-5b73-5def-863b-43c052e63e32 with identifier: UN77217 to the API
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:20Z',
 'fuel_type': 'petrol',
 'id': '0e5b5348-5b73-5def-863b-43c052e63e32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN77217',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 70995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2013}
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-28 20:31:56 [auto1.be] INFO: Saving data for UN77217: {'auction_closing_time': 1774883720.0, 'created_time': 1774557033.83047, 'last_price_update_time': 1774729916.234592}
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UN77217') HTTP/1.1" 204 0
2026-03-28 20:31:56 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 20:31:56 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-28 20:31:56 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-28 20:31:56 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-28 20:31:56 [auto1.be] INFO: Scrape type for NS73936: 2
2026-03-28 20:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-28 20:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with scrape type 2
2026-03-28 20:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with scrape type 2
2026-03-28 20:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127, identifier: NS73936
2026-03-28 20:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-28 20:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936
2026-03-28 20:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127 with identifier: NS73936 to the API
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:12:01Z',
 'fuel_type': 'petrol',
 'id': '8b4cd6a3-d55b-5ea3-88a4-bbf5b2657127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS73936',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 58170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-28 20:31:56 [auto1.be] INFO: Saving data for NS73936: {'auction_closing_time': 1774883521.0, 'created_time': 1774524682.966644, 'last_price_update_time': 1774729916.789493}
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS73936') HTTP/1.1" 204 0
2026-03-28 20:31:56 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 20:31:56 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 20:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:31:57 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1094 | hits on page: 40
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-28 20:31:57 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-28 20:31:57 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-28 20:31:57 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-28 20:31:57 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-28 20:31:57 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 20:31:57 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-28 20:31:57 [auto1.be] INFO: Scrape type for TR87241: 2
2026-03-28 20:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-28 20:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723da491-dff4-5725-97f1-c814e1c6991f with scrape type 2
2026-03-28 20:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723da491-dff4-5725-97f1-c814e1c6991f with scrape type 2
2026-03-28 20:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 723da491-dff4-5725-97f1-c814e1c6991f, identifier: TR87241
2026-03-28 20:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-28 20:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241
2026-03-28 20:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 723da491-dff4-5725-97f1-c814e1c6991f with identifier: TR87241 to the API
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '723da491-dff4-5725-97f1-c814e1c6991f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR87241',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 131420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Saving data for TR87241: {'auction_closing_time': 1774884468.0, 'created_time': 1774524714.970198, 'last_price_update_time': 1774729918.307267}
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR87241') HTTP/1.1" 204 0
2026-03-28 20:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for DJ08738: 2
2026-03-28 20:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738
2026-03-28 20:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6253c09c-e24e-52be-bf97-c105ea6690f8 with scrape type 2
2026-03-28 20:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6253c09c-e24e-52be-bf97-c105ea6690f8 with scrape type 2
2026-03-28 20:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6253c09c-e24e-52be-bf97-c105ea6690f8, identifier: DJ08738
2026-03-28 20:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738
2026-03-28 20:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738
2026-03-28 20:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6253c09c-e24e-52be-bf97-c105ea6690f8 with identifier: DJ08738 to the API
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:53:47Z',
 'fuel_type': 'diesel',
 'id': '6253c09c-e24e-52be-bf97-c105ea6690f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ08738',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 238631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Saving data for DJ08738: {'auction_closing_time': 1774886027.0, 'created_time': 1773349431.501062, 'last_price_update_time': 1774729918.865904}
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ08738') HTTP/1.1" 204 0
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for SN22557: 1
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 20:31:58 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-28 20:31:58 [auto1.be] INFO: Scrape type for PS82481: 1
2026-03-28 20:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for AZ39903: 1
2026-03-28 20:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for NL83155: 2
2026-03-28 20:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155
2026-03-28 20:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09cb5409-1661-5876-b159-aa86aeb6d79b with scrape type 2
2026-03-28 20:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09cb5409-1661-5876-b159-aa86aeb6d79b with scrape type 2
2026-03-28 20:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09cb5409-1661-5876-b159-aa86aeb6d79b, identifier: NL83155
2026-03-28 20:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155
2026-03-28 20:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155
2026-03-28 20:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09cb5409-1661-5876-b159-aa86aeb6d79b with identifier: NL83155 to the API
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:52:00Z',
 'fuel_type': 'hybrid',
 'id': '09cb5409-1661-5876-b159-aa86aeb6d79b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL83155',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 232527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 1.6 T-GDI Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2022}
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Saving data for NL83155: {'auction_closing_time': 1774885920.0, 'created_time': 1774002051.720764, 'last_price_update_time': 1774729919.514981}
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NL83155') HTTP/1.1" 204 0
2026-03-28 20:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for PF94112: 1
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for XT95399: 1
2026-03-28 20:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:31:59 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-28 20:31:59 [auto1.be] INFO: Scrape type for NT98676: 2
2026-03-28 20:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676
2026-03-28 20:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with scrape type 2
2026-03-28 20:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with scrape type 2
2026-03-28 20:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: df4d6ab1-c882-5e9a-9f24-38ec02f25d49, identifier: NT98676
2026-03-28 20:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676
2026-03-28 20:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676
2026-03-28 20:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: df4d6ab1-c882-5e9a-9f24-38ec02f25d49 with identifier: NT98676 to the API
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:13:56Z',
 'fuel_type': 'diesel',
 'id': 'df4d6ab1-c882-5e9a-9f24-38ec02f25d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT98676',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 80974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2016}
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Saving data for NT98676: {'auction_closing_time': 1774883636.0, 'created_time': 1773348770.796634, 'last_price_update_time': 1774729920.098675}
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NT98676') HTTP/1.1" 204 0
2026-03-28 20:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for ZA12378: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for FJ54867: 1
2026-03-28 20:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-28 20:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:00 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1094 | hits on page: 40
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA04427%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for FA04427: 1
2026-03-28 20:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for KD88013: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for YY44687: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for BX66623: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ37001%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for NJ37001: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for DM24490: 1
2026-03-28 20:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN22557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for PM87207: 1
2026-03-28 20:32:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for XW30503: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for UE36464: 1
2026-03-28 20:32:00 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-28 20:32:00 [auto1.be] INFO: Scrape type for ER02883: 2
2026-03-28 20:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883
2026-03-28 20:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9f088b6-ff39-58be-b9c4-e444d2ca44dd with scrape type 2
2026-03-28 20:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9f088b6-ff39-58be-b9c4-e444d2ca44dd with scrape type 2
2026-03-28 20:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9f088b6-ff39-58be-b9c4-e444d2ca44dd, identifier: ER02883
2026-03-28 20:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883
2026-03-28 20:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883
2026-03-28 20:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9f088b6-ff39-58be-b9c4-e444d2ca44dd with identifier: ER02883 to the API
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'diesel',
 'id': 'c9f088b6-ff39-58be-b9c4-e444d2ca44dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER02883',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 63280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi HDi',
 'transmission': 'manual',
 'trim': 'HDi',
 'year': 2013}
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Saving data for ER02883: {'auction_closing_time': 1774885152.0, 'created_time': 1774001877.925007, 'last_price_update_time': 1774729921.228885}
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER02883') HTTP/1.1" 204 0
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for HT18059: 1
2026-03-28 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF94112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ39903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for PE64709: 1
2026-03-28 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT95399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ54867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA12378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS82481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for ZM05640: 1
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for KT01454: 1
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for AC59433: 2
2026-03-28 20:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433
2026-03-28 20:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9664b1b-d541-56c0-add5-f44f972b267d with scrape type 2
2026-03-28 20:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9664b1b-d541-56c0-add5-f44f972b267d with scrape type 2
2026-03-28 20:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9664b1b-d541-56c0-add5-f44f972b267d, identifier: AC59433
2026-03-28 20:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433
2026-03-28 20:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433
2026-03-28 20:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9664b1b-d541-56c0-add5-f44f972b267d with identifier: AC59433 to the API
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:11:21Z',
 'fuel_type': 'diesel',
 'id': 'f9664b1b-d541-56c0-add5-f44f972b267d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC59433',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 180365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Kia Soul 1.6 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Saving data for AC59433: {'auction_closing_time': 1774883481.0, 'created_time': 1773348458.506899, 'last_price_update_time': 1774729921.873033}
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC59433') HTTP/1.1" 204 0
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for GM68229: 1
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for LK30146: 1
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for UA37218: 1
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-28 20:32:01 [auto1.be] INFO: Scrape type for NZ75648: 1
2026-03-28 20:32:01 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-28 20:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for ER91021: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for EM88075: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for UV16393: 1
2026-03-28 20:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:02 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1094 | hits on page: 40
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for AY92488: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for WH35268: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for RL22884: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for DZ29736: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for ZN30582: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for DW89604: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for JB30712: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for XK23104: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for SG83875: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for UM29446: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for XS20349: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for TA24587: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for MM51411: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for EM05161: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: US61524
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for DP44577: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for KU92863: 1
2026-03-28 20:32:02 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-28 20:32:02 [auto1.be] INFO: Scrape type for XU79591: 2
2026-03-28 20:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591
2026-03-28 20:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0129a20-c7cd-5be9-9e10-19e70ec33f76 with scrape type 2
2026-03-28 20:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0129a20-c7cd-5be9-9e10-19e70ec33f76 with scrape type 2
2026-03-28 20:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0129a20-c7cd-5be9-9e10-19e70ec33f76, identifier: XU79591
2026-03-28 20:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591
2026-03-28 20:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591
2026-03-28 20:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0129a20-c7cd-5be9-9e10-19e70ec33f76 with identifier: XU79591 to the API
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:08Z',
 'fuel_type': 'petrol',
 'id': 'd0129a20-c7cd-5be9-9e10-19e70ec33f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU79591',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 138734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-10',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Saving data for XU79591: {'auction_closing_time': 1774886168.0, 'created_time': 1774001880.760963, 'last_price_update_time': 1774729923.054674}
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU79591') HTTP/1.1" 204 0
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for LM11563: 1
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM87207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA04427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for VZ26705: 1
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX66623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM24490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ37001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY44687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW30503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for GW19918: 1
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for UY14877: 1
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for GN49517: 1
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for BE30988: 1
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for LA99224: 1
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-28 20:32:03 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Scrape type for GJ36560: 2
2026-03-28 20:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560
2026-03-28 20:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with scrape type 2
2026-03-28 20:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with scrape type 2
2026-03-28 20:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9660a33-5bf1-57d7-9178-aabb1a7e72b9, identifier: GJ36560
2026-03-28 20:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560
2026-03-28 20:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560
2026-03-28 20:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9660a33-5bf1-57d7-9178-aabb1a7e72b9 with identifier: GJ36560 to the API
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:34Z',
 'fuel_type': 'diesel',
 'id': 'c9660a33-5bf1-57d7-9178-aabb1a7e72b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ36560',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 203973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
 'transmission': 'manual',
 'trim': 'Driver M',
 'year': 2022}
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-28 20:32:03 [auto1.be] INFO: Saving data for GJ36560: {'auction_closing_time': 1774884274.0, 'created_time': 1773349269.031738, 'last_price_update_time': 1774729923.743613}
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ36560') HTTP/1.1" 204 0
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE64709/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM68229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM05640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE36464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT01454/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT18059/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN22557> (referer: https://www.auto1.com/v1/car-details-view/SN22557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557
2026-03-28 20:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c68377-9458-530d-8c69-990ea6be5db1 with scrape type 1
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15c68377-9458-530d-8c69-990ea6be5db1
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_967eb9d2967bc55dc5e2040f67e9695f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_967eb9d2967bc55dc5e2040f67e9695f.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_2b542dbc0c696c49b7fc059c40788a33.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_2b542dbc0c696c49b7fc059c40788a33.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_f4c7117a5b76585268ad79d7af188a92.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_f4c7117a5b76585268ad79d7af188a92.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_f8f7c53c39acadad3890b7608cc26d8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_f8f7c53c39acadad3890b7608cc26d8e.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_57e1724f70a82b611f86b5bba47de72d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_57e1724f70a82b611f86b5bba47de72d.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_eb332ce9c866ffdf3fbb6011e1b00e24.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_eb332ce9c866ffdf3fbb6011e1b00e24.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_ba8a5bd3044e7a6f689663e803b16682.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_ba8a5bd3044e7a6f689663e803b16682.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_8dbd671fe8dfd68460c9816b3d0ddcf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_8dbd671fe8dfd68460c9816b3d0ddcf2.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_6f442ab8fafdb11ea84fdcf2c59f39cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_6f442ab8fafdb11ea84fdcf2c59f39cf.jpg already downloaded
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Ff6%252F78f61a0c47322ea3f7df00280f352a26%252Fpa%252FSN22557_c005763893adb33983f2e53531ffd047.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_c005763893adb33983f2e53531ffd047.jpg already downloaded
2026-03-28 20:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15c68377-9458-530d-8c69-990ea6be5db1, identifier: SN22557
2026-03-28 20:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557
2026-03-28 20:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557
2026-03-28 20:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15c68377-9458-530d-8c69-990ea6be5db1 with identifier: SN22557 to the API
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN22557>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:36:10Z',
 'fuel_type': 'diesel',
 'id': '15c68377-9458-530d-8c69-990ea6be5db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN22557',
 'listing': 'auction',
 'location': 'BE, Anderlues',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 155085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_967eb9d2967bc55dc5e2040f67e9695f.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_2b542dbc0c696c49b7fc059c40788a33.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_f4c7117a5b76585268ad79d7af188a92.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_f8f7c53c39acadad3890b7608cc26d8e.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_57e1724f70a82b611f86b5bba47de72d.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_eb332ce9c866ffdf3fbb6011e1b00e24.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_ba8a5bd3044e7a6f689663e803b16682.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_8dbd671fe8dfd68460c9816b3d0ddcf2.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_6f442ab8fafdb11ea84fdcf2c59f39cf.jpg',
                'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_c005763893adb33983f2e53531ffd047.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_967eb9d2967bc55dc5e2040f67e9695f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_2b542dbc0c696c49b7fc059c40788a33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_f4c7117a5b76585268ad79d7af188a92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_f8f7c53c39acadad3890b7608cc26d8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_57e1724f70a82b611f86b5bba47de72d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_eb332ce9c866ffdf3fbb6011e1b00e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_ba8a5bd3044e7a6f689663e803b16682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_8dbd671fe8dfd68460c9816b3d0ddcf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_6f442ab8fafdb11ea84fdcf2c59f39cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c68377-9458-530d-8c69-990ea6be5db1/15c68377-9458-530d-8c69-990ea6be5db1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/f6/78f61a0c47322ea3f7df00280f352a26/pa/SN22557_c005763893adb33983f2e53531ffd047.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-28 20:32:05 [auto1.be] INFO: Saving data for SN22557: {'created_time': 1774729925.726207, 'last_price_update_time': 1774729925.726219, 'auction_closing_time': 1774884970.0}
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN22557') HTTP/1.1" 204 0
2026-03-28 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP44577/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM05161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU92863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM11563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV16393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA24587/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW30503> (referer: https://www.auto1.com/v1/car-details-view/XW30503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM51411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503
2026-03-28 20:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0f2cb4-1123-521d-b42d-39ab21270083 with scrape type 1
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_69c2bb4b1020919b29458855cb0aed52.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_69c2bb4b1020919b29458855cb0aed52.jpg not downloaded yet
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_7f87f090a189d49554f98197b398eac7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_7f87f090a189d49554f98197b398eac7.jpg not downloaded yet
2026-03-28 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE64709> (referer: https://www.auto1.com/v1/car-details-view/PE64709/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg not downloaded yet
2026-03-28 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_4cdfdcff2437d4bdf25c3b4f00736862.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_4cdfdcff2437d4bdf25c3b4f00736862.jpg not downloaded yet
2026-03-28 20:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY44687> (referer: https://www.auto1.com/v1/car-details-view/YY44687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_27bdf165eade819eea60f12e5d58afb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_27bdf165eade819eea60f12e5d58afb9.jpg not downloaded yet
2026-03-28 20:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_44ef047a9e8d9a952c82ed4171e54e90.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_44ef047a9e8d9a952c82ed4171e54e90.jpg not downloaded yet
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_8dc5b7275badd41f291c8536019f2c60.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_8dc5b7275badd41f291c8536019f2c60.jpg not downloaded yet
2026-03-28 20:32:06 [scrapy.extensions.logstats] INFO: Crawled 87 pages (at 58 pages/min), scraped 92 items (at 69 items/min)
2026-03-28 20:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_0c15ed86d6e22229b06e54ba35ed011f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_0c15ed86d6e22229b06e54ba35ed011f.jpg not downloaded yet
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_aa8037ed669927912b5138fc6b61035a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_aa8037ed669927912b5138fc6b61035a.jpg not downloaded yet
2026-03-28 20:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709
2026-03-28 20:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a98804c-4fff-5fba-a931-235c16769837 with scrape type 1
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a98804c-4fff-5fba-a931-235c16769837
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_4bf01443412bf4c2d4f962f38b9cdf9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_4bf01443412bf4c2d4f962f38b9cdf9e.jpg already downloaded
2026-03-28 20:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_b0d0b167eb14bb5e0f56dd3ae984ffa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_b0d0b167eb14bb5e0f56dd3ae984ffa4.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_922508968a673a60ec7ccaebd04727e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_922508968a673a60ec7ccaebd04727e9.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_97b2d359412ec0b3877451d597680553.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_97b2d359412ec0b3877451d597680553.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_4e3a228f9c10cf3dbbe74973cb4b8e68.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_4e3a228f9c10cf3dbbe74973cb4b8e68.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_ddab68f72d704cbb36a0a131a6634788.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_ddab68f72d704cbb36a0a131a6634788.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_ff0075c209ab541a68335c9d061e4f5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_ff0075c209ab541a68335c9d061e4f5e.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_95acb6478554b216e68dbb5dd336107b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_95acb6478554b216e68dbb5dd336107b.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_2420183d74a7cc30cac477267cfaa3f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_2420183d74a7cc30cac477267cfaa3f8.jpg already downloaded
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F2b%252F262ba1a62dc5958e441ce58875635dc1%252Fpa%252FPE64709_21ab3472f6cbe9b007f41ef89b3d5b0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_21ab3472f6cbe9b007f41ef89b3d5b0c.jpg already downloaded
2026-03-28 20:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a98804c-4fff-5fba-a931-235c16769837, identifier: PE64709
2026-03-28 20:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709
2026-03-28 20:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709
2026-03-28 20:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a98804c-4fff-5fba-a931-235c16769837 with identifier: PE64709 to the API
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE64709>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:40Z',
 'fuel_type': 'petrol',
 'id': '4a98804c-4fff-5fba-a931-235c16769837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE64709',
 'listing': 'auction',
 'location': 'BE, Anderlues',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 152669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_4bf01443412bf4c2d4f962f38b9cdf9e.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_b0d0b167eb14bb5e0f56dd3ae984ffa4.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_922508968a673a60ec7ccaebd04727e9.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_97b2d359412ec0b3877451d597680553.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_4e3a228f9c10cf3dbbe74973cb4b8e68.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_ddab68f72d704cbb36a0a131a6634788.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_ff0075c209ab541a68335c9d061e4f5e.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_95acb6478554b216e68dbb5dd336107b.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_2420183d74a7cc30cac477267cfaa3f8.jpg',
                'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_21ab3472f6cbe9b007f41ef89b3d5b0c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_4bf01443412bf4c2d4f962f38b9cdf9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_b0d0b167eb14bb5e0f56dd3ae984ffa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_922508968a673a60ec7ccaebd04727e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_97b2d359412ec0b3877451d597680553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_4e3a228f9c10cf3dbbe74973cb4b8e68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_ddab68f72d704cbb36a0a131a6634788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_ff0075c209ab541a68335c9d061e4f5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_95acb6478554b216e68dbb5dd336107b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_2420183d74a7cc30cac477267cfaa3f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a98804c-4fff-5fba-a931-235c16769837/4a98804c-4fff-5fba-a931-235c16769837_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/2b/262ba1a62dc5958e441ce58875635dc1/pa/PE64709_21ab3472f6cbe9b007f41ef89b3d5b0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.4 TURBO LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2013}
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [auto1.be] INFO: Saving data for PE64709: {'created_time': 1774729928.058403, 'last_price_update_time': 1774729928.058416, 'auction_closing_time': 1774884280.0}
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE64709') HTTP/1.1" 204 0
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_1965eb1955abd265b079dc4392a270cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_1965eb1955abd265b079dc4392a270cd.jpg not downloaded yet
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_7f87f090a189d49554f98197b398eac7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM05640> (referer: https://www.auto1.com/v1/car-details-view/ZM05640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ37001> (referer: https://www.auto1.com/v1/car-details-view/NJ37001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687
2026-03-28 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdb769a-0e22-516c-aee5-02d7c62683f1 with scrape type 1
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_762c0e10a9c9d236c05b214e86094f96.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_762c0e10a9c9d236c05b214e86094f96.jpg not downloaded yet
2026-03-28 20:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM24490> (referer: https://www.auto1.com/v1/car-details-view/DM24490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_2ae3ebc0b7076f9089e9d497106a840d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2ae3ebc0b7076f9089e9d497106a840d.jpg not downloaded yet
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS20349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_b4fb94adfacd94258ae77537a046602e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b4fb94adfacd94258ae77537a046602e.jpg not downloaded yet
2026-03-28 20:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD88013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_cada49e985e003ecdc59555a8ac6c963.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_cada49e985e003ecdc59555a8ac6c963.jpg not downloaded yet
2026-03-28 20:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_2f0e837743c542e80bd4bc344e6e28bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2f0e837743c542e80bd4bc344e6e28bb.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_bb080539204bb7d7a744ebb8704a775d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_bb080539204bb7d7a744ebb8704a775d.jpg not downloaded yet
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173080e50>
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_7f87f090a189d49554f98197b398eac7.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_7f87f090a189d49554f98197b398eac7.jpg saved to cache
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640
2026-03-28 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with scrape type 1
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg not downloaded yet
2026-03-28 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 with identifier: NJ37001
2026-03-28 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 with scrape type 1
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg not downloaded yet
2026-03-28 20:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490
2026-03-28 20:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with scrape type 1
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_90efc5a25742ca17fa4ab33bf3c10940.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_90efc5a25742ca17fa4ab33bf3c10940.jpg not downloaded yet
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b4fb94adfacd94258ae77537a046602e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_835c8dcf5ab6930c8f3c626dcbd69c12.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_835c8dcf5ab6930c8f3c626dcbd69c12.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_f4dc5f100f0ba24663629c4e5c7d0ef1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_f4dc5f100f0ba24663629c4e5c7d0ef1.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_efb1e5e43b16bad783988ae9707ed978.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_efb1e5e43b16bad783988ae9707ed978.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_1235c878a600fe879991507177f60672.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1235c878a600fe879991507177f60672.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_349c01163ae7871952bfb086b03c5f0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_349c01163ae7871952bfb086b03c5f0c.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_bf40d7d79306d46a06a2ee928713246c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bf40d7d79306d46a06a2ee928713246c.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_1b687b3a46d57ae7bc56bea7c83fc153.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1b687b3a46d57ae7bc56bea7c83fc153.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_e95e5b8b2a291e4c8d97ba0d17acde9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_e95e5b8b2a291e4c8d97ba0d17acde9b.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_b591e28c2d0e9b3420b98aede4faa97d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b591e28c2d0e9b3420b98aede4faa97d.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_bbfca180826d6afd722b0edc28746b6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bbfca180826d6afd722b0edc28746b6b.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_cb5b4f8072ecb848042a988ff2da1ab4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_cb5b4f8072ecb848042a988ff2da1ab4.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_356b1446116d00233d325d5b9e1c46a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_356b1446116d00233d325d5b9e1c46a0.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_341043b67fd7593103f14982772adb58.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_341043b67fd7593103f14982772adb58.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_17ecc497638089413b010f225649f95a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_17ecc497638089413b010f225649f95a.jpg not downloaded yet
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_3b48efb1aa71b0c1b86cef1ca9978e60.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_3b48efb1aa71b0c1b86cef1ca9978e60.jpg not downloaded yet
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bcb90>
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_b4fb94adfacd94258ae77537a046602e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b4fb94adfacd94258ae77537a046602e.jpg saved to cache
2026-03-28 20:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT18059> (referer: https://www.auto1.com/v1/car-details-view/HT18059/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_a850c6cce85d0f2e89b5fe7706253375.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_a850c6cce85d0f2e89b5fe7706253375.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_3928642e5e1a1248ecaef3cb6fcc9109.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_3928642e5e1a1248ecaef3cb6fcc9109.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_1baabe4e3ab945811b08196d0e77de10.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1baabe4e3ab945811b08196d0e77de10.jpg not downloaded yet
2026-03-28 20:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_dd74739a46e2376d1c3713cbd8700b98.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_dd74739a46e2376d1c3713cbd8700b98.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_13a5bd32c81e985c5514fe51c541f18a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_13a5bd32c81e985c5514fe51c541f18a.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_890a5e246b1cd8b9cc0cea4f9a97991f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_890a5e246b1cd8b9cc0cea4f9a97991f.jpg not downloaded yet
2026-03-28 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE36464> (referer: https://www.auto1.com/v1/car-details-view/UE36464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_cf585dc4135d3ce16e3fbb392e6f7b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_cf585dc4135d3ce16e3fbb392e6f7b9f.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_35a933267e51b7e3795e908e8bec366b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_35a933267e51b7e3795e908e8bec366b.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_8069cd6f049df38efe068cbc7acc6b38.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_8069cd6f049df38efe068cbc7acc6b38.jpg not downloaded yet
2026-03-28 20:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059
2026-03-28 20:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with scrape type 1
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_d31c53984bbaa478871528e8297cab92.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_d31c53984bbaa478871528e8297cab92.jpg not downloaded yet
2026-03-28 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_3b48efb1aa71b0c1b86cef1ca9978e60.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_8edb849bf3c86c07abce426ac94ee937.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8edb849bf3c86c07abce426ac94ee937.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_0286e0e81fcbb3387121c624787daddc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_0286e0e81fcbb3387121c624787daddc.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_77c189a92a060aa6015b5b0a015e5ad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_77c189a92a060aa6015b5b0a015e5ad1.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_343192b72a09c1b109934c5f1bc206e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_343192b72a09c1b109934c5f1bc206e8.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_8ba140abfaf0e0cf90fdd33c6a6bfa4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8ba140abfaf0e0cf90fdd33c6a6bfa4e.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_736539a590995a21e98168a281b3ad63.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_736539a590995a21e98168a281b3ad63.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_5a8f2b9a36311612aa5c4b647014ef4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_5a8f2b9a36311612aa5c4b647014ef4c.jpg not downloaded yet
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_2f93000aa4801fd03975648264901711.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_2f93000aa4801fd03975648264901711.jpg not downloaded yet
2026-03-28 20:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464
2026-03-28 20:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca17713-763f-5607-a49f-d3ff58b6c062 with scrape type 1
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ca17713-763f-5607-a49f-d3ff58b6c062
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_433a1fcfd61594d7ffee4904dad193b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_433a1fcfd61594d7ffee4904dad193b1.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_ef0f33607b4c0d882b64241968638c3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_ef0f33607b4c0d882b64241968638c3e.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_1e92f806641bf4bb775928ad082258f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_1e92f806641bf4bb775928ad082258f9.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_693445ad8dcfef3ed657e3e82af51f34.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_693445ad8dcfef3ed657e3e82af51f34.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_3c33b5e8d20f429ca9652351a806de37.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_3c33b5e8d20f429ca9652351a806de37.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_7c1cc56cc7072b642645c6e69c175637.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_7c1cc56cc7072b642645c6e69c175637.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_cbe2fc91fc596feebebd58f9894bc90f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_cbe2fc91fc596feebebd58f9894bc90f.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_3cfd3ed0966f2f26f69587060ae03cc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_3cfd3ed0966f2f26f69587060ae03cc2.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_f3844e256ef1f0f81979fd6266d1ac9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_f3844e256ef1f0f81979fd6266d1ac9f.jpg already downloaded
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F95%252F6e958d44d195ac829f04d238df7724ef%252Fpa%252FUE36464_4257f45a2cc97c86c5aae5a7406a88db.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_4257f45a2cc97c86c5aae5a7406a88db.jpg already downloaded
2026-03-28 20:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ca17713-763f-5607-a49f-d3ff58b6c062, identifier: UE36464
2026-03-28 20:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT01454> (referer: https://www.auto1.com/v1/car-details-view/KT01454/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464
2026-03-28 20:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464
2026-03-28 20:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ca17713-763f-5607-a49f-d3ff58b6c062 with identifier: UE36464 to the API
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UE36464>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:35Z',
 'fuel_type': 'petrol',
 'id': '3ca17713-763f-5607-a49f-d3ff58b6c062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE36464',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 212956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_433a1fcfd61594d7ffee4904dad193b1.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_ef0f33607b4c0d882b64241968638c3e.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_1e92f806641bf4bb775928ad082258f9.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_693445ad8dcfef3ed657e3e82af51f34.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_3c33b5e8d20f429ca9652351a806de37.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_7c1cc56cc7072b642645c6e69c175637.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_cbe2fc91fc596feebebd58f9894bc90f.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_3cfd3ed0966f2f26f69587060ae03cc2.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_f3844e256ef1f0f81979fd6266d1ac9f.jpg',
                'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_4257f45a2cc97c86c5aae5a7406a88db.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_433a1fcfd61594d7ffee4904dad193b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_ef0f33607b4c0d882b64241968638c3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_1e92f806641bf4bb775928ad082258f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_693445ad8dcfef3ed657e3e82af51f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_3c33b5e8d20f429ca9652351a806de37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_7c1cc56cc7072b642645c6e69c175637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_cbe2fc91fc596feebebd58f9894bc90f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_3cfd3ed0966f2f26f69587060ae03cc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_f3844e256ef1f0f81979fd6266d1ac9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca17713-763f-5607-a49f-d3ff58b6c062/3ca17713-763f-5607-a49f-d3ff58b6c062_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/95/6e958d44d195ac829f04d238df7724ef/pa/UE36464_4257f45a2cc97c86c5aae5a7406a88db.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-28 20:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [auto1.be] INFO: Saving data for UE36464: {'created_time': 1774729930.00689, 'last_price_update_time': 1774729930.0069, 'auction_closing_time': 1774885115.0}
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UE36464') HTTP/1.1" 204 0
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_890a5e246b1cd8b9cc0cea4f9a97991f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_8069cd6f049df38efe068cbc7acc6b38.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_f3a138f551b355dfc59e6323fb4017ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_f3a138f551b355dfc59e6323fb4017ff.jpg not downloaded yet
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU92863> (referer: https://www.auto1.com/v1/car-details-view/KU92863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17329d4d0>
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_3b48efb1aa71b0c1b86cef1ca9978e60.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_3b48efb1aa71b0c1b86cef1ca9978e60.jpg saved to cache
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX66623> (referer: https://www.auto1.com/v1/car-details-view/BX66623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM11563> (referer: https://www.auto1.com/v1/car-details-view/LM11563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_4143ab10fc79a159e6040a2c9b543c88.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_4143ab10fc79a159e6040a2c9b543c88.jpg not downloaded yet
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM68229> (referer: https://www.auto1.com/v1/car-details-view/GM68229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV16393> (referer: https://www.auto1.com/v1/car-details-view/UV16393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_4cdfdcff2437d4bdf25c3b4f00736862.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454
2026-03-28 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with scrape type 1
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_1a2c882969c8576aefc981c55af1b597.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_1a2c882969c8576aefc981c55af1b597.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_28a0ac6a626dc379585c0ff424ab1c6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_28a0ac6a626dc379585c0ff424ab1c6e.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_dba0db38150f3516845e22a7d30f8095.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_dba0db38150f3516845e22a7d30f8095.jpg not downloaded yet
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173033510>
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_890a5e246b1cd8b9cc0cea4f9a97991f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_890a5e246b1cd8b9cc0cea4f9a97991f.jpg saved to cache
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f00bd0>
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_8069cd6f049df38efe068cbc7acc6b38.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_8069cd6f049df38efe068cbc7acc6b38.jpg saved to cache
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863
2026-03-28 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2b04e0-a58a-5b95-b9db-290f8629daa3 with scrape type 1
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_15fb925836c9217d70176dfefa36ae42.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_15fb925836c9217d70176dfefa36ae42.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_4af95ecb6e34a154a777d83ab35986f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_4af95ecb6e34a154a777d83ab35986f7.jpg not downloaded yet
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_5a8f2b9a36311612aa5c4b647014ef4c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_37dea7c2b6ef3d38772051264084cfc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_37dea7c2b6ef3d38772051264084cfc3.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_1fa3bd156b1b8d59347b4bb35d4d98ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_1fa3bd156b1b8d59347b4bb35d4d98ad.jpg not downloaded yet
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_aa8037ed669927912b5138fc6b61035a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_2f93000aa4801fd03975648264901711.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_fb7d97e53ce126bd49252339df693af1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_fb7d97e53ce126bd49252339df693af1.jpg not downloaded yet
2026-03-28 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623
2026-03-28 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aada4d1-3ace-5315-a4be-6ee742d97578 with scrape type 1
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg not downloaded yet
2026-03-28 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563
2026-03-28 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcac546b-4965-5ea5-95cb-dd8d70f8833f with scrape type 1
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_ba142383f223f651c6ca094d5d57344c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_ba142383f223f651c6ca094d5d57344c.jpg not downloaded yet
2026-03-28 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229
2026-03-28 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e398921-f1a7-52b2-93bb-1880f80d2236 with scrape type 1
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1e398921-f1a7-52b2-93bb-1880f80d2236
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg not downloaded yet
2026-03-28 20:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393
2026-03-28 20:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with scrape type 1
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg not downloaded yet
2026-03-28 20:32:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17306a590>
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_4cdfdcff2437d4bdf25c3b4f00736862.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_4cdfdcff2437d4bdf25c3b4f00736862.jpg saved to cache
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_30ed51770b5c65fb4c02f88659de944e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_30ed51770b5c65fb4c02f88659de944e.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_f6ae01e6fe3c7b5b3de9b52bdc4094ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f6ae01e6fe3c7b5b3de9b52bdc4094ec.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_748b461121437b6c5bfd26febc774300.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_748b461121437b6c5bfd26febc774300.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_280087104e8faea342d17a3be8c58606.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_280087104e8faea342d17a3be8c58606.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_7f2f3cb19674aa66be9b70fd729fdc40.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_7f2f3cb19674aa66be9b70fd729fdc40.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_58324aff9e66bdabcd7190a414124712.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_58324aff9e66bdabcd7190a414124712.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_6c6f26b85a6ea665c6a374ce57f49624.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6c6f26b85a6ea665c6a374ce57f49624.jpg not downloaded yet
2026-03-28 20:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_0c15ed86d6e22229b06e54ba35ed011f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_912f3d04ddea15934564dc3ef38edbf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_912f3d04ddea15934564dc3ef38edbf0.jpg not downloaded yet
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_f224111b5475467ab2da10fc7e3c1f20.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f224111b5475467ab2da10fc7e3c1f20.jpg not downloaded yet
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720ed250>
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_5a8f2b9a36311612aa5c4b647014ef4c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_5a8f2b9a36311612aa5c4b647014ef4c.jpg saved to cache
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726fa310>
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_aa8037ed669927912b5138fc6b61035a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_aa8037ed669927912b5138fc6b61035a.jpg saved to cache
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721a2290>
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_2f93000aa4801fd03975648264901711.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_2f93000aa4801fd03975648264901711.jpg saved to cache
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_ecab3a129a4ff97487a68b86b06de86a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_ecab3a129a4ff97487a68b86b06de86a.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_e1f4a1339cdcb651a186c09f52a4c45a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_e1f4a1339cdcb651a186c09f52a4c45a.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_acd0da02aed42ffce89afc4f1e4a09d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_acd0da02aed42ffce89afc4f1e4a09d2.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_837bb9eac8a282909eee5f116bcf1ab8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_837bb9eac8a282909eee5f116bcf1ab8.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_29e4beb52ed18c947be410a21da652c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_29e4beb52ed18c947be410a21da652c7.jpg not downloaded yet
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_736539a590995a21e98168a281b3ad63.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8ba140abfaf0e0cf90fdd33c6a6bfa4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_591e7b1ba67c9be1fae32917167b30b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_591e7b1ba67c9be1fae32917167b30b4.jpg not downloaded yet
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS20349> (referer: https://www.auto1.com/v1/car-details-view/XS20349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA24587> (referer: https://www.auto1.com/v1/car-details-view/TA24587/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_762c0e10a9c9d236c05b214e86094f96.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_343192b72a09c1b109934c5f1bc206e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_912c681700dae1d2c494608de8021c5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_912c681700dae1d2c494608de8021c5c.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_4b1948b8b5d069c44c297c0004621002.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_4b1948b8b5d069c44c297c0004621002.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_53328b25825a1947c281101d74c49726.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_53328b25825a1947c281101d74c49726.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_2e98acdf61f0524612298c11df1c30ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_2e98acdf61f0524612298c11df1c30ea.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_edf38837e9ad5ee1495e3041c4988aac.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_edf38837e9ad5ee1495e3041c4988aac.jpg not downloaded yet
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172167210>
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_0c15ed86d6e22229b06e54ba35ed011f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_0c15ed86d6e22229b06e54ba35ed011f.jpg saved to cache
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2ae3ebc0b7076f9089e9d497106a840d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_7db52354a5d065f9e658f5de7eb4f39c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_7db52354a5d065f9e658f5de7eb4f39c.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_cc5525cdee9dd643b5ac1b994acfcead.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_cc5525cdee9dd643b5ac1b994acfcead.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_b1113b23ffa0b21dc51a9b429718ae69.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_b1113b23ffa0b21dc51a9b429718ae69.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_dfb5b006dd611fe6f8d85c957e14d85e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_dfb5b006dd611fe6f8d85c957e14d85e.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_77d9ed20880d30c449694ccf4897c972.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_77d9ed20880d30c449694ccf4897c972.jpg not downloaded yet
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_3bca83b7735a3e06b7a0386128e705dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3bca83b7735a3e06b7a0386128e705dc.jpg not downloaded yet
2026-03-28 20:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_1965eb1955abd265b079dc4392a270cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721408d0>
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_736539a590995a21e98168a281b3ad63.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_736539a590995a21e98168a281b3ad63.jpg saved to cache
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732e4410>
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_8ba140abfaf0e0cf90fdd33c6a6bfa4e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8ba140abfaf0e0cf90fdd33c6a6bfa4e.jpg saved to cache
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349
2026-03-28 20:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with scrape type 1
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4682f7ee-2454-50d6-8255-6ee32f89f0d4
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_f39cbee1ce402f3cb24a4748d88e6b93.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_f39cbee1ce402f3cb24a4748d88e6b93.jpg already downloaded
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_9e9f06ffdf442d6e089365a197b97b69.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_9e9f06ffdf442d6e089365a197b97b69.jpg already downloaded
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_30d1809800736cc64367ee195d94af68.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_30d1809800736cc64367ee195d94af68.jpg already downloaded
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_57ae171b0ee97142e3374bd98c947a37.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_57ae171b0ee97142e3374bd98c947a37.jpg already downloaded
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_eed439d6462ba02eb21171027454ed79.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_eed439d6462ba02eb21171027454ed79.jpg already downloaded
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_6ccea9cfe72fdb6507ae9443a17a38b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_6ccea9cfe72fdb6507ae9443a17a38b3.jpg already downloaded
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_dd51e9e1ec8fde6190065335a7debf6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_dd51e9e1ec8fde6190065335a7debf6a.jpg already downloaded
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_718e92b5c02becac1337ab114f2a153b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_718e92b5c02becac1337ab114f2a153b.jpg already downloaded
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_4f3b11db970fab81f992adf2b5a0417f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_4f3b11db970fab81f992adf2b5a0417f.jpg already downloaded
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F85%252Fab8519d2a18bfd24600a9e9e2010c9f5%252Fpa%252FXS20349_7337ea07919a60832c6faeb524df58e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_7337ea07919a60832c6faeb524df58e7.jpg already downloaded
2026-03-28 20:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4682f7ee-2454-50d6-8255-6ee32f89f0d4, identifier: XS20349
2026-03-28 20:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587
2026-03-28 20:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa172659-02ea-5472-9b78-a1927b8042af with scrape type 1
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_4b3e5af161abe6a5b2b6500e4fb834b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_4b3e5af161abe6a5b2b6500e4fb834b9.jpg not downloaded yet
2026-03-28 20:32:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fc2e50>
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_762c0e10a9c9d236c05b214e86094f96.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_762c0e10a9c9d236c05b214e86094f96.jpg saved to cache
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720aa7d0>
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_343192b72a09c1b109934c5f1bc206e8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_343192b72a09c1b109934c5f1bc206e8.jpg saved to cache
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_843a6b4c9cd0d9e858f494db0b9fe263.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_843a6b4c9cd0d9e858f494db0b9fe263.jpg not downloaded yet
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_3cf46b52bffce2e4596eda1d34f2d7a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_3cf46b52bffce2e4596eda1d34f2d7a4.jpg not downloaded yet
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_2f6ce783aa597394cc46a6e4e6ae0cab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_2f6ce783aa597394cc46a6e4e6ae0cab.jpg not downloaded yet
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_6a8199e65952f61121cd7875f07c011f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6a8199e65952f61121cd7875f07c011f.jpg not downloaded yet
2026-03-28 20:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349
2026-03-28 20:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349
2026-03-28 20:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4682f7ee-2454-50d6-8255-6ee32f89f0d4 with identifier: XS20349 to the API
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS20349>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'petrol',
 'id': '4682f7ee-2454-50d6-8255-6ee32f89f0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS20349',
 'listing': 'auction',
 'location': 'BE, Anderlues',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 128558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_f39cbee1ce402f3cb24a4748d88e6b93.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_9e9f06ffdf442d6e089365a197b97b69.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_30d1809800736cc64367ee195d94af68.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_57ae171b0ee97142e3374bd98c947a37.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_eed439d6462ba02eb21171027454ed79.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_6ccea9cfe72fdb6507ae9443a17a38b3.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_dd51e9e1ec8fde6190065335a7debf6a.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_718e92b5c02becac1337ab114f2a153b.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_4f3b11db970fab81f992adf2b5a0417f.jpg',
                'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_7337ea07919a60832c6faeb524df58e7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_f39cbee1ce402f3cb24a4748d88e6b93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_9e9f06ffdf442d6e089365a197b97b69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_30d1809800736cc64367ee195d94af68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_57ae171b0ee97142e3374bd98c947a37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_eed439d6462ba02eb21171027454ed79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_6ccea9cfe72fdb6507ae9443a17a38b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_dd51e9e1ec8fde6190065335a7debf6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_718e92b5c02becac1337ab114f2a153b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_4f3b11db970fab81f992adf2b5a0417f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4682f7ee-2454-50d6-8255-6ee32f89f0d4/4682f7ee-2454-50d6-8255-6ee32f89f0d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/85/ab8519d2a18bfd24600a9e9e2010c9f5/pa/XS20349_7337ea07919a60832c6faeb524df58e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [auto1.be] INFO: Saving data for XS20349: {'created_time': 1774729932.849263, 'last_price_update_time': 1774729932.849275, 'auction_closing_time': 1774885299.0}
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS20349') HTTP/1.1" 204 0
2026-03-28 20:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_77c189a92a060aa6015b5b0a015e5ad1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_1fa3bd156b1b8d59347b4bb35d4d98ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_79c7b8b30a82925b36b730a41f8aaa0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_79c7b8b30a82925b36b730a41f8aaa0d.jpg not downloaded yet
2026-03-28 20:32:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725730d0>
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_2ae3ebc0b7076f9089e9d497106a840d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2ae3ebc0b7076f9089e9d497106a840d.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8edb849bf3c86c07abce426ac94ee937.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_37dea7c2b6ef3d38772051264084cfc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_3a826e94c0e0ad839e73c59399375351.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_3a826e94c0e0ad839e73c59399375351.jpg not downloaded yet
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_d206ecd4688e7a5e2459b3711779ce42.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_d206ecd4688e7a5e2459b3711779ce42.jpg not downloaded yet
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_f8686e3162e7e090f66c56de7b644dad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f8686e3162e7e090f66c56de7b644dad.jpg not downloaded yet
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721115d0>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_1965eb1955abd265b079dc4392a270cd.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_1965eb1955abd265b079dc4392a270cd.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_3f6d43f5547c5c0b1564c96442c48a07.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3f6d43f5547c5c0b1564c96442c48a07.jpg not downloaded yet
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f92d10>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_77c189a92a060aa6015b5b0a015e5ad1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_77c189a92a060aa6015b5b0a015e5ad1.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17211de50>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_1fa3bd156b1b8d59347b4bb35d4d98ad.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_1fa3bd156b1b8d59347b4bb35d4d98ad.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg not downloaded yet
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_a4487536f7902555479c18df602edc9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_a4487536f7902555479c18df602edc9d.jpg not downloaded yet
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720d7d50>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_8edb849bf3c86c07abce426ac94ee937.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8edb849bf3c86c07abce426ac94ee937.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172572250>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_37dea7c2b6ef3d38772051264084cfc3.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_37dea7c2b6ef3d38772051264084cfc3.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_f150ce435804fbdef08b9da4c996817e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f150ce435804fbdef08b9da4c996817e.jpg not downloaded yet
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6a8199e65952f61121cd7875f07c011f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_2274cf0f3df784b1495e43159e4c871d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_2274cf0f3df784b1495e43159e4c871d.jpg not downloaded yet
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_0286e0e81fcbb3387121c624787daddc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_cb21572f340c712ec37720e869ba1eb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_cb21572f340c712ec37720e869ba1eb8.jpg not downloaded yet
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_369d6276f40c94f39b6547c4e31dba35.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_369d6276f40c94f39b6547c4e31dba35.jpg not downloaded yet
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_79c7b8b30a82925b36b730a41f8aaa0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_01e539aaca27958597059724a66f31f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_01e539aaca27958597059724a66f31f3.jpg not downloaded yet
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_3c5a8eee4b197e758763888d39d16ef2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_3c5a8eee4b197e758763888d39d16ef2.jpg not downloaded yet
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_3cf46b52bffce2e4596eda1d34f2d7a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_5c7580a0530079e7f396127aa06a3502.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_5c7580a0530079e7f396127aa06a3502.jpg not downloaded yet
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c4650>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_6a8199e65952f61121cd7875f07c011f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6a8199e65952f61121cd7875f07c011f.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726e6590>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_0286e0e81fcbb3387121c624787daddc.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_0286e0e81fcbb3387121c624787daddc.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726eac10>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_79c7b8b30a82925b36b730a41f8aaa0d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_79c7b8b30a82925b36b730a41f8aaa0d.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_2f6ce783aa597394cc46a6e4e6ae0cab.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726e4390>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_3cf46b52bffce2e4596eda1d34f2d7a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_3cf46b52bffce2e4596eda1d34f2d7a4.jpg saved to cache
2026-03-28 20:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_843a6b4c9cd0d9e858f494db0b9fe263.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_f3a138f551b355dfc59e6323fb4017ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_d206ecd4688e7a5e2459b3711779ce42.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6c6f26b85a6ea665c6a374ce57f49624.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_4af95ecb6e34a154a777d83ab35986f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_3a826e94c0e0ad839e73c59399375351.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3bca83b7735a3e06b7a0386128e705dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_4b3e5af161abe6a5b2b6500e4fb834b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c5b90>
2026-03-28 20:32:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_2f6ce783aa597394cc46a6e4e6ae0cab.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_2f6ce783aa597394cc46a6e4e6ae0cab.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_77d9ed20880d30c449694ccf4897c972.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_dfb5b006dd611fe6f8d85c957e14d85e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_b1113b23ffa0b21dc51a9b429718ae69.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17269e910>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_843a6b4c9cd0d9e858f494db0b9fe263.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_843a6b4c9cd0d9e858f494db0b9fe263.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179a1b290>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_f3a138f551b355dfc59e6323fb4017ff.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_f3a138f551b355dfc59e6323fb4017ff.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_2274cf0f3df784b1495e43159e4c871d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_01e539aaca27958597059724a66f31f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_3c5a8eee4b197e758763888d39d16ef2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726e8750>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_d206ecd4688e7a5e2459b3711779ce42.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_d206ecd4688e7a5e2459b3711779ce42.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172528290>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_6c6f26b85a6ea665c6a374ce57f49624.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6c6f26b85a6ea665c6a374ce57f49624.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172647c90>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_4af95ecb6e34a154a777d83ab35986f7.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_4af95ecb6e34a154a777d83ab35986f7.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725057d0>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_3a826e94c0e0ad839e73c59399375351.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_3a826e94c0e0ad839e73c59399375351.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172570c90>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_3bca83b7735a3e06b7a0386128e705dc.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3bca83b7735a3e06b7a0386128e705dc.jpg saved to cache
2026-03-28 20:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a01d0>
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_4b3e5af161abe6a5b2b6500e4fb834b9.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_4b3e5af161abe6a5b2b6500e4fb834b9.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726f28d0>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_77d9ed20880d30c449694ccf4897c972.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_77d9ed20880d30c449694ccf4897c972.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e398921-f1a7-52b2-93bb-1880f80d2236
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172644d50>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_dfb5b006dd611fe6f8d85c957e14d85e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_dfb5b006dd611fe6f8d85c957e14d85e.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725070d0>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_b1113b23ffa0b21dc51a9b429718ae69.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_b1113b23ffa0b21dc51a9b429718ae69.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f1f150>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_2274cf0f3df784b1495e43159e4c871d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_2274cf0f3df784b1495e43159e4c871d.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172512a10>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_01e539aaca27958597059724a66f31f3.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_01e539aaca27958597059724a66f31f3.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f2da50>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_3c5a8eee4b197e758763888d39d16ef2.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_3c5a8eee4b197e758763888d39d16ef2.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_369d6276f40c94f39b6547c4e31dba35.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f150ce435804fbdef08b9da4c996817e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_a4487536f7902555479c18df602edc9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_5c7580a0530079e7f396127aa06a3502.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_cb21572f340c712ec37720e869ba1eb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3f6d43f5547c5c0b1564c96442c48a07.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_2e98acdf61f0524612298c11df1c30ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_53328b25825a1947c281101d74c49726.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_7db52354a5d065f9e658f5de7eb4f39c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_4b1948b8b5d069c44c297c0004621002.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216f350>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_369d6276f40c94f39b6547c4e31dba35.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_369d6276f40c94f39b6547c4e31dba35.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_591e7b1ba67c9be1fae32917167b30b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f8686e3162e7e090f66c56de7b644dad.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216d010>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_f150ce435804fbdef08b9da4c996817e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f150ce435804fbdef08b9da4c996817e.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_837bb9eac8a282909eee5f116bcf1ab8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720abf90>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_a4487536f7902555479c18df602edc9d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_a4487536f7902555479c18df602edc9d.jpg saved to cache
2026-03-28 20:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726be110>
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_5c7580a0530079e7f396127aa06a3502.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_5c7580a0530079e7f396127aa06a3502.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179428e90>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_cb21572f340c712ec37720e869ba1eb8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_cb21572f340c712ec37720e869ba1eb8.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d8f10>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_3f6d43f5547c5c0b1564c96442c48a07.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3f6d43f5547c5c0b1564c96442c48a07.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c5190>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_2e98acdf61f0524612298c11df1c30ea.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_2e98acdf61f0524612298c11df1c30ea.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e398921-f1a7-52b2-93bb-1880f80d2236
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f2d390>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_53328b25825a1947c281101d74c49726.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_53328b25825a1947c281101d74c49726.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172522d90>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_7db52354a5d065f9e658f5de7eb4f39c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_7db52354a5d065f9e658f5de7eb4f39c.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172112150>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_4b1948b8b5d069c44c297c0004621002.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_4b1948b8b5d069c44c297c0004621002.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172615350>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_591e7b1ba67c9be1fae32917167b30b4.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_591e7b1ba67c9be1fae32917167b30b4.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172687f90>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_f8686e3162e7e090f66c56de7b644dad.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f8686e3162e7e090f66c56de7b644dad.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172138350>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_837bb9eac8a282909eee5f116bcf1ab8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_837bb9eac8a282909eee5f116bcf1ab8.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e398921-f1a7-52b2-93bb-1880f80d2236
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_edf38837e9ad5ee1495e3041c4988aac.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_29e4beb52ed18c947be410a21da652c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_912c681700dae1d2c494608de8021c5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_cc5525cdee9dd643b5ac1b994acfcead.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_acd0da02aed42ffce89afc4f1e4a09d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_e1f4a1339cdcb651a186c09f52a4c45a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_58324aff9e66bdabcd7190a414124712.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f224111b5475467ab2da10fc7e3c1f20.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_280087104e8faea342d17a3be8c58606.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_7f2f3cb19674aa66be9b70fd729fdc40.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172671a50>
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fea%252F78ea86c590a6881c89af4bc10382d6b9%252Fpa%252FTA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg saved to cache
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa172659-02ea-5472-9b78-a1927b8042af
2026-03-28 20:32:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa172659-02ea-5472-9b78-a1927b8042af, skipping ID generation
2026-03-28 20:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa172659-02ea-5472-9b78-a1927b8042af with scrape type 1
2026-03-28 20:32:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa172659-02ea-5472-9b78-a1927b8042af sending to next pipeline
2026-03-28 20:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa172659-02ea-5472-9b78-a1927b8042af, identifier: TA24587
2026-03-28 20:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587
2026-03-28 20:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587
2026-03-28 20:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa172659-02ea-5472-9b78-a1927b8042af with identifier: TA24587 to the API
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'diesel',
 'id': 'fa172659-02ea-5472-9b78-a1927b8042af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA24587',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 133000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_4b3e5af161abe6a5b2b6500e4fb834b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_79c7b8b30a82925b36b730a41f8aaa0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f8686e3162e7e090f66c56de7b644dad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2202529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_aa1aeda2889bdccdb2e063597ad747b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2272269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_f150ce435804fbdef08b9da4c996817e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_cb21572f340c712ec37720e869ba1eb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2207334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_369d6276f40c94f39b6547c4e31dba35.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_01e539aaca27958597059724a66f31f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_3c5a8eee4b197e758763888d39d16ef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa172659-02ea-5472-9b78-a1927b8042af/fa172659-02ea-5472-9b78-a1927b8042af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ea/78ea86c590a6881c89af4bc10382d6b9/pa/TA24587_5c7580a0530079e7f396127aa06a3502.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2017}
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-28 20:32:17 [auto1.be] INFO: Saving data for TA24587: {'created_time': 1774729937.700695, 'last_price_update_time': 1774729937.70071, 'auction_closing_time': 1774883944.0}
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TA24587') HTTP/1.1" 204 0
2026-03-28 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_ecab3a129a4ff97487a68b86b06de86a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f6ae01e6fe3c7b5b3de9b52bdc4094ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731cffd0>
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_edf38837e9ad5ee1495e3041c4988aac.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_edf38837e9ad5ee1495e3041c4988aac.jpg saved to cache
2026-03-28 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179429710>
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_29e4beb52ed18c947be410a21da652c7.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_29e4beb52ed18c947be410a21da652c7.jpg saved to cache
2026-03-28 20:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172629390>
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_912c681700dae1d2c494608de8021c5c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_912c681700dae1d2c494608de8021c5c.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308b6d0>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_cc5525cdee9dd643b5ac1b994acfcead.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_cc5525cdee9dd643b5ac1b994acfcead.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17314dd50>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_acd0da02aed42ffce89afc4f1e4a09d2.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_acd0da02aed42ffce89afc4f1e4a09d2.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bf610>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_e1f4a1339cdcb651a186c09f52a4c45a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_e1f4a1339cdcb651a186c09f52a4c45a.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721a2690>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_58324aff9e66bdabcd7190a414124712.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_58324aff9e66bdabcd7190a414124712.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e398921-f1a7-52b2-93bb-1880f80d2236
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f2c2d0>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_f224111b5475467ab2da10fc7e3c1f20.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f224111b5475467ab2da10fc7e3c1f20.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172536690>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_280087104e8faea342d17a3be8c58606.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_280087104e8faea342d17a3be8c58606.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f37190>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_7f2f3cb19674aa66be9b70fd729fdc40.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_7f2f3cb19674aa66be9b70fd729fdc40.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726da890>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3f%252F293fe6b935668538b63bacacfa2d24e7%252Fpa%252FGM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e398921-f1a7-52b2-93bb-1880f80d2236
2026-03-28 20:32:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e398921-f1a7-52b2-93bb-1880f80d2236, skipping ID generation
2026-03-28 20:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e398921-f1a7-52b2-93bb-1880f80d2236 with scrape type 1
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e398921-f1a7-52b2-93bb-1880f80d2236 sending to next pipeline
2026-03-28 20:32:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1e398921-f1a7-52b2-93bb-1880f80d2236, identifier: GM68229
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172140dd0>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_ecab3a129a4ff97487a68b86b06de86a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_ecab3a129a4ff97487a68b86b06de86a.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726da3d0>
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_f6ae01e6fe3c7b5b3de9b52bdc4094ec.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f6ae01e6fe3c7b5b3de9b52bdc4094ec.jpg saved to cache
2026-03-28 20:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229
2026-03-28 20:32:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229
2026-03-28 20:32:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1e398921-f1a7-52b2-93bb-1880f80d2236 with identifier: GM68229 to the API
2026-03-28 20:32:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:42:35Z',
 'fuel_type': 'petrol',
 'id': '1e398921-f1a7-52b2-93bb-1880f80d2236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM68229',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 234107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_9a9b652ef8b4ce4bcb5c811990cb37ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_58324aff9e66bdabcd7190a414124712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_837bb9eac8a282909eee5f116bcf1ab8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_2e98acdf61f0524612298c11df1c30ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e398921-f1a7-52b2-93bb-1880f80d2236/1e398921-f1a7-52b2-93bb-1880f80d2236_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3f/293fe6b935668538b63bacacfa2d24e7/pa/GM68229_77d9ed20880d30c449694ccf4897c972.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-28 20:32:19 [auto1.be] INFO: Saving data for GM68229: {'created_time': 1774729939.211768, 'last_price_update_time': 1774729939.211779, 'auction_closing_time': 1774885355.0}
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM68229') HTTP/1.1" 204 0
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_912f3d04ddea15934564dc3ef38edbf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_30ed51770b5c65fb4c02f88659de944e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_748b461121437b6c5bfd26febc774300.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_ba142383f223f651c6ca094d5d57344c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_15fb925836c9217d70176dfefa36ae42.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_d31c53984bbaa478871528e8297cab92.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790dda50>
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_912f3d04ddea15934564dc3ef38edbf0.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_912f3d04ddea15934564dc3ef38edbf0.jpg saved to cache
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_fb7d97e53ce126bd49252339df693af1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726da5d0>
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F92%252F4a9281673c093a5675e8dc34025f1738%252Fpa%252FUV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg saved to cache
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f
2026-03-28 20:32:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f, skipping ID generation
2026-03-28 20:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with scrape type 1
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4aa19d84-0bd7-5397-9a69-d121b13f1a0f sending to next pipeline
2026-03-28 20:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f, identifier: UV16393
2026-03-28 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173069d90>
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_30ed51770b5c65fb4c02f88659de944e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_30ed51770b5c65fb4c02f88659de944e.jpg saved to cache
2026-03-28 20:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730f4710>
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_748b461121437b6c5bfd26febc774300.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_748b461121437b6c5bfd26febc774300.jpg saved to cache
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172655390>
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fb7%252F78b740285a996177115a9f0577fce358%252Fpa%252FLM11563_ba142383f223f651c6ca094d5d57344c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_ba142383f223f651c6ca094d5d57344c.jpg saved to cache
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcac546b-4965-5ea5-95cb-dd8d70f8833f
2026-03-28 20:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcac546b-4965-5ea5-95cb-dd8d70f8833f, skipping ID generation
2026-03-28 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcac546b-4965-5ea5-95cb-dd8d70f8833f with scrape type 1
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcac546b-4965-5ea5-95cb-dd8d70f8833f sending to next pipeline
2026-03-28 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fcac546b-4965-5ea5-95cb-dd8d70f8833f, identifier: LM11563
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172656f90>
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b895f08bdf1f13c30a505e5ff746d6a%252Fpa%252FKU92863_15fb925836c9217d70176dfefa36ae42.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_15fb925836c9217d70176dfefa36ae42.jpg saved to cache
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2b04e0-a58a-5b95-b9db-290f8629daa3
2026-03-28 20:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb2b04e0-a58a-5b95-b9db-290f8629daa3, skipping ID generation
2026-03-28 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2b04e0-a58a-5b95-b9db-290f8629daa3 with scrape type 1
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2b04e0-a58a-5b95-b9db-290f8629daa3 sending to next pipeline
2026-03-28 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb2b04e0-a58a-5b95-b9db-290f8629daa3, identifier: KU92863
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d9d50>
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F44%252Fdb4423a6311f9a99bfd3d428d0815b2a%252Fpa%252FBX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg saved to cache
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1aada4d1-3ace-5315-a4be-6ee742d97578
2026-03-28 20:32:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1aada4d1-3ace-5315-a4be-6ee742d97578, skipping ID generation
2026-03-28 20:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aada4d1-3ace-5315-a4be-6ee742d97578 with scrape type 1
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1aada4d1-3ace-5315-a4be-6ee742d97578 sending to next pipeline
2026-03-28 20:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1aada4d1-3ace-5315-a4be-6ee742d97578, identifier: BX66623
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730f5f10>
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_d31c53984bbaa478871528e8297cab92.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_d31c53984bbaa478871528e8297cab92.jpg saved to cache
2026-03-28 20:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393
2026-03-28 20:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393
2026-03-28 20:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4aa19d84-0bd7-5397-9a69-d121b13f1a0f with identifier: UV16393 to the API
2026-03-28 20:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:20:45Z',
 'fuel_type': 'diesel',
 'id': '4aa19d84-0bd7-5397-9a69-d121b13f1a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV16393',
 'listing': 'auction',
 'location': 'BE, Ardooie',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 121286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_0ad82f9108747e4e1d57d79792a0f6a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6c6f26b85a6ea665c6a374ce57f49624.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2415276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_29e4beb52ed18c947be410a21da652c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_edf38837e9ad5ee1495e3041c4988aac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3bca83b7735a3e06b7a0386128e705dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_6a8199e65952f61121cd7875f07c011f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1791130,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_d206ecd4688e7a5e2459b3711779ce42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_3f6d43f5547c5c0b1564c96442c48a07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_a4487536f7902555479c18df602edc9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4aa19d84-0bd7-5397-9a69-d121b13f1a0f/4aa19d84-0bd7-5397-9a69-d121b13f1a0f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/92/4a9281673c093a5675e8dc34025f1738/pa/UV16393_2274cf0f3df784b1495e43159e4c871d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2014}
2026-03-28 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-28 20:32:21 [auto1.be] INFO: Saving data for UV16393: {'created_time': 1774729941.976499, 'last_price_update_time': 1774729941.976511, 'auction_closing_time': 1774884045.0}
2026-03-28 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV16393') HTTP/1.1" 204 0
2026-03-28 20:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563
2026-03-28 20:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563
2026-03-28 20:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fcac546b-4965-5ea5-95cb-dd8d70f8833f with identifier: LM11563 to the API
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_ba142383f223f651c6ca094d5d57344c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:30:48Z',
 'fuel_type': 'petrol',
 'id': 'fcac546b-4965-5ea5-95cb-dd8d70f8833f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM11563',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 115488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_ba142383f223f651c6ca094d5d57344c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_7f2f3cb19674aa66be9b70fd729fdc40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_acd0da02aed42ffce89afc4f1e4a09d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_53328b25825a1947c281101d74c49726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_dfb5b006dd611fe6f8d85c957e14d85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcac546b-4965-5ea5-95cb-dd8d70f8833f/fcac546b-4965-5ea5-95cb-dd8d70f8833f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/b7/78b740285a996177115a9f0577fce358/pa/LM11563_2f6ce783aa597394cc46a6e4e6ae0cab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-28 20:32:22 [auto1.be] INFO: Saving data for LM11563: {'created_time': 1774729942.375647, 'last_price_update_time': 1774729942.37566, 'auction_closing_time': 1774884648.0}
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM11563') HTTP/1.1" 204 0
2026-03-28 20:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863
2026-03-28 20:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863
2026-03-28 20:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb2b04e0-a58a-5b95-b9db-290f8629daa3 with identifier: KU92863 to the API
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_15fb925836c9217d70176dfefa36ae42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:57:14Z',
 'fuel_type': 'diesel',
 'id': 'cb2b04e0-a58a-5b95-b9db-290f8629daa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU92863',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 209006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_15fb925836c9217d70176dfefa36ae42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_1fa3bd156b1b8d59347b4bb35d4d98ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f6ae01e6fe3c7b5b3de9b52bdc4094ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_f224111b5475467ab2da10fc7e3c1f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_591e7b1ba67c9be1fae32917167b30b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2b04e0-a58a-5b95-b9db-290f8629daa3/cb2b04e0-a58a-5b95-b9db-290f8629daa3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b895f08bdf1f13c30a505e5ff746d6a/pa/KU92863_7db52354a5d065f9e658f5de7eb4f39c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2011}
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-28 20:32:22 [auto1.be] INFO: Saving data for KU92863: {'created_time': 1774729942.863435, 'last_price_update_time': 1774729942.863448, 'auction_closing_time': 1774886234.0}
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU92863') HTTP/1.1" 204 0
2026-03-28 20:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623
2026-03-28 20:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623
2026-03-28 20:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1aada4d1-3ace-5315-a4be-6ee742d97578 with identifier: BX66623 to the API
2026-03-28 20:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'petrol',
 'id': '1aada4d1-3ace-5315-a4be-6ee742d97578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX66623',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 83206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_a9b95c4f13bc1e7436d3dc5026036cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_280087104e8faea342d17a3be8c58606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_e1f4a1339cdcb651a186c09f52a4c45a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_4b1948b8b5d069c44c297c0004621002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_b1113b23ffa0b21dc51a9b429718ae69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aada4d1-3ace-5315-a4be-6ee742d97578/1aada4d1-3ace-5315-a4be-6ee742d97578_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/44/db4423a6311f9a99bfd3d428d0815b2a/pa/BX66623_3cf46b52bffce2e4596eda1d34f2d7a4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Terra',
 'transmission': 'manual',
 'trim': 'Terra',
 'year': 2003}
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-28 20:32:23 [auto1.be] INFO: Saving data for BX66623: {'created_time': 1774729943.259469, 'last_price_update_time': 1774729943.259484, 'auction_closing_time': 1774886120.0}
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX66623') HTTP/1.1" 204 0
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_cf585dc4135d3ce16e3fbb392e6f7b9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_13a5bd32c81e985c5514fe51c541f18a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f238d0>
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_fb7d97e53ce126bd49252339df693af1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_fb7d97e53ce126bd49252339df693af1.jpg saved to cache
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_35a933267e51b7e3795e908e8bec366b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_dba0db38150f3516845e22a7d30f8095.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_28a0ac6a626dc379585c0ff424ab1c6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_4143ab10fc79a159e6040a2c9b543c88.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_1a2c882969c8576aefc981c55af1b597.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17941c350>
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_cf585dc4135d3ce16e3fbb392e6f7b9f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_cf585dc4135d3ce16e3fbb392e6f7b9f.jpg saved to cache
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1baabe4e3ab945811b08196d0e77de10.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_341043b67fd7593103f14982772adb58.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_a850c6cce85d0f2e89b5fe7706253375.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173290550>
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_13a5bd32c81e985c5514fe51c541f18a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_13a5bd32c81e985c5514fe51c541f18a.jpg saved to cache
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d6d90>
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_35a933267e51b7e3795e908e8bec366b.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_35a933267e51b7e3795e908e8bec366b.jpg saved to cache
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730b6250>
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_dba0db38150f3516845e22a7d30f8095.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_dba0db38150f3516845e22a7d30f8095.jpg saved to cache
2026-03-28 20:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fa9c50>
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_28a0ac6a626dc379585c0ff424ab1c6e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_28a0ac6a626dc379585c0ff424ab1c6e.jpg saved to cache
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720d78d0>
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fd7%252Fb9d79ed06303de062b59508414ffc450%252Fpa%252FHT18059_4143ab10fc79a159e6040a2c9b543c88.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_4143ab10fc79a159e6040a2c9b543c88.jpg saved to cache
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5
2026-03-28 20:32:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96a6b3ab-bec2-5d71-805b-b155d2d119b5, skipping ID generation
2026-03-28 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with scrape type 1
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96a6b3ab-bec2-5d71-805b-b155d2d119b5 sending to next pipeline
2026-03-28 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a6b3ab-bec2-5d71-805b-b155d2d119b5, identifier: HT18059
2026-03-28 20:32:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172506310>
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_1a2c882969c8576aefc981c55af1b597.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_1a2c882969c8576aefc981c55af1b597.jpg saved to cache
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b6750>
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fee%252F02ee58537b941a6ccc2a2b6a93303090%252Fpa%252FKT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg saved to cache
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b
2026-03-28 20:32:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b, skipping ID generation
2026-03-28 20:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with scrape type 1
2026-03-28 20:32:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b sending to next pipeline
2026-03-28 20:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b, identifier: KT01454
2026-03-28 20:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_dd74739a46e2376d1c3713cbd8700b98.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059
2026-03-28 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059
2026-03-28 20:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a6b3ab-bec2-5d71-805b-b155d2d119b5 with identifier: HT18059 to the API
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_4143ab10fc79a159e6040a2c9b543c88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'diesel',
 'id': '96a6b3ab-bec2-5d71-805b-b155d2d119b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT18059',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_d31c53984bbaa478871528e8297cab92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_343192b72a09c1b109934c5f1bc206e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_2f93000aa4801fd03975648264901711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2681161,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_f3a138f551b355dfc59e6323fb4017ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2666861,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_4143ab10fc79a159e6040a2c9b543c88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_28a0ac6a626dc379585c0ff424ab1c6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_dba0db38150f3516845e22a7d30f8095.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_37dea7c2b6ef3d38772051264084cfc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_30ed51770b5c65fb4c02f88659de944e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a6b3ab-bec2-5d71-805b-b155d2d119b5/96a6b3ab-bec2-5d71-805b-b155d2d119b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869554,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/d7/b9d79ed06303de062b59508414ffc450/pa/HT18059_912f3d04ddea15934564dc3ef38edbf0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC AMG Line',
 'transmission': 'manual',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-28 20:32:24 [auto1.be] INFO: Saving data for HT18059: {'created_time': 1774729944.957124, 'last_price_update_time': 1774729944.957136, 'auction_closing_time': 1774883764.0}
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT18059') HTTP/1.1" 204 0
2026-03-28 20:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454
2026-03-28 20:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454
2026-03-28 20:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ab82dcf-e6eb-5711-bcd5-62f7bd47182b with identifier: KT01454 to the API
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'diesel',
 'id': '4ab82dcf-e6eb-5711-bcd5-62f7bd47182b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT01454',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 106263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3328391,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_1a2c882969c8576aefc981c55af1b597.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3376235,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_b64768a2d6b61c90c1c5fe7e585e25a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_4af95ecb6e34a154a777d83ab35986f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_fb7d97e53ce126bd49252339df693af1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_748b461121437b6c5bfd26febc774300.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_ecab3a129a4ff97487a68b86b06de86a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_912c681700dae1d2c494608de8021c5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3209039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_cc5525cdee9dd643b5ac1b994acfcead.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_843a6b4c9cd0d9e858f494db0b9fe263.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab82dcf-e6eb-5711-bcd5-62f7bd47182b/4ab82dcf-e6eb-5711-bcd5-62f7bd47182b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2923261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/ee/02ee58537b941a6ccc2a2b6a93303090/pa/KT01454_3a826e94c0e0ad839e73c59399375351.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2019}
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-28 20:32:25 [auto1.be] INFO: Saving data for KT01454: {'created_time': 1774729945.397327, 'last_price_update_time': 1774729945.39734, 'auction_closing_time': 1774885944.0}
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT01454') HTTP/1.1" 204 0
2026-03-28 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_cb5b4f8072ecb848042a988ff2da1ab4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bbfca180826d6afd722b0edc28746b6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e7150>
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_1baabe4e3ab945811b08196d0e77de10.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1baabe4e3ab945811b08196d0e77de10.jpg saved to cache
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f93710>
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_341043b67fd7593103f14982772adb58.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_341043b67fd7593103f14982772adb58.jpg saved to cache
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721112d0>
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_a850c6cce85d0f2e89b5fe7706253375.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_a850c6cce85d0f2e89b5fe7706253375.jpg saved to cache
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f93f50>
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_dd74739a46e2376d1c3713cbd8700b98.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_dd74739a46e2376d1c3713cbd8700b98.jpg saved to cache
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_17ecc497638089413b010f225649f95a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_3928642e5e1a1248ecaef3cb6fcc9109.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732f9590>
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_cb5b4f8072ecb848042a988ff2da1ab4.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_cb5b4f8072ecb848042a988ff2da1ab4.jpg saved to cache
2026-03-28 20:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179609590>
2026-03-28 20:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_bbfca180826d6afd722b0edc28746b6b.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bbfca180826d6afd722b0edc28746b6b.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bf40d7d79306d46a06a2ee928713246c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_e95e5b8b2a291e4c8d97ba0d17acde9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725242d0>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_17ecc497638089413b010f225649f95a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_17ecc497638089413b010f225649f95a.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17912b150>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_3928642e5e1a1248ecaef3cb6fcc9109.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_3928642e5e1a1248ecaef3cb6fcc9109.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1b687b3a46d57ae7bc56bea7c83fc153.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_f4dc5f100f0ba24663629c4e5c7d0ef1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173071790>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_bf40d7d79306d46a06a2ee928713246c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bf40d7d79306d46a06a2ee928713246c.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726ab810>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_e95e5b8b2a291e4c8d97ba0d17acde9b.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_e95e5b8b2a291e4c8d97ba0d17acde9b.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1235c878a600fe879991507177f60672.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_90efc5a25742ca17fa4ab33bf3c10940.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173030dd0>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_1b687b3a46d57ae7bc56bea7c83fc153.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1b687b3a46d57ae7bc56bea7c83fc153.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff4210>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_f4dc5f100f0ba24663629c4e5c7d0ef1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_f4dc5f100f0ba24663629c4e5c7d0ef1.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_efb1e5e43b16bad783988ae9707ed978.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_835c8dcf5ab6930c8f3c626dcbd69c12.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172524550>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_1235c878a600fe879991507177f60672.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1235c878a600fe879991507177f60672.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730335d0>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_90efc5a25742ca17fa4ab33bf3c10940.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_90efc5a25742ca17fa4ab33bf3c10940.jpg saved to cache
2026-03-28 20:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2f0e837743c542e80bd4bc344e6e28bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_cada49e985e003ecdc59555a8ac6c963.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17306e5d0>
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_efb1e5e43b16bad783988ae9707ed978.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_efb1e5e43b16bad783988ae9707ed978.jpg saved to cache
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173196250>
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_835c8dcf5ab6930c8f3c626dcbd69c12.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_835c8dcf5ab6930c8f3c626dcbd69c12.jpg saved to cache
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172549150>
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F64%252F65647f96e596ff74ef329859cf5eaac5%252Fpa%252FZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg saved to cache
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13
2026-03-28 20:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a62d7aee-4196-5a13-9ec7-7d0e5e259d13, skipping ID generation
2026-03-28 20:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with scrape type 1
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a62d7aee-4196-5a13-9ec7-7d0e5e259d13 sending to next pipeline
2026-03-28 20:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a62d7aee-4196-5a13-9ec7-7d0e5e259d13, identifier: ZM05640
2026-03-28 20:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_356b1446116d00233d325d5b9e1c46a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640
2026-03-28 20:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640
2026-03-28 20:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a62d7aee-4196-5a13-9ec7-7d0e5e259d13 with identifier: ZM05640 to the API
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:01:20Z',
 'fuel_type': 'petrol',
 'id': 'a62d7aee-4196-5a13-9ec7-7d0e5e259d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM05640',
 'listing': 'auction',
 'location': 'BE, Retie',
 'make': 'Citroen',
 'model': 'C-Elysée',
 'odometer': 78808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_ca85de0c91c3c30b8696d62dc702bbff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_f4dc5f100f0ba24663629c4e5c7d0ef1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bf40d7d79306d46a06a2ee928713246c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_bbfca180826d6afd722b0edc28746b6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_341043b67fd7593103f14982772adb58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_a850c6cce85d0f2e89b5fe7706253375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_dd74739a46e2376d1c3713cbd8700b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_cf585dc4135d3ce16e3fbb392e6f7b9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8edb849bf3c86c07abce426ac94ee937.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62d7aee-4196-5a13-9ec7-7d0e5e259d13/a62d7aee-4196-5a13-9ec7-7d0e5e259d13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/64/65647f96e596ff74ef329859cf5eaac5/pa/ZM05640_8ba140abfaf0e0cf90fdd33c6a6bfa4e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C-Elysée 1.6 VTi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2018}
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-28 20:32:27 [auto1.be] INFO: Saving data for ZM05640: {'created_time': 1774729947.67714, 'last_price_update_time': 1774729947.67715, 'auction_closing_time': 1774882880.0}
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM05640') HTTP/1.1" 204 0
2026-03-28 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_8dc5b7275badd41f291c8536019f2c60.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_44ef047a9e8d9a952c82ed4171e54e90.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e5150>
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_2f0e837743c542e80bd4bc344e6e28bb.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2f0e837743c542e80bd4bc344e6e28bb.jpg saved to cache
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17251ce90>
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_cada49e985e003ecdc59555a8ac6c963.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_cada49e985e003ecdc59555a8ac6c963.jpg saved to cache
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720ee750>
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fa0%252Fb1a0bdb657da2e0a25c69f8f17086fcd%252Fpa%252FDM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg saved to cache
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c
2026-03-28 20:32:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c, skipping ID generation
2026-03-28 20:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with scrape type 1
2026-03-28 20:32:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c sending to next pipeline
2026-03-28 20:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c, identifier: DM24490
2026-03-28 20:32:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa186dc4f50>
2026-03-28 20:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_356b1446116d00233d325d5b9e1c46a0.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_356b1446116d00233d325d5b9e1c46a0.jpg saved to cache
2026-03-28 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216de50>
2026-03-28 20:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F15%252F34151b2e6626f239129c2b6a78929b5b%252Fpa%252FNJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg saved to cache
2026-03-28 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41
2026-03-28 20:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8430c6d-c0ef-5400-a1a7-8f6d8af11b41, skipping ID generation
2026-03-28 20:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 with scrape type 1
2026-03-28 20:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 sending to next pipeline
2026-03-28 20:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8430c6d-c0ef-5400-a1a7-8f6d8af11b41, identifier: NJ37001
2026-03-28 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490
2026-03-28 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490
2026-03-28 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490 to the API
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:18:59Z',
 'fuel_type': 'petrol',
 'id': '1fbdb8be-a155-52e5-908e-73e7f9e9a06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM24490',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 46570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_90efc5a25742ca17fa4ab33bf3c10940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 454438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1235c878a600fe879991507177f60672.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_e95e5b8b2a291e4c8d97ba0d17acde9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_6fb1bdc6063c82941dc743f87483d1c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_3b48efb1aa71b0c1b86cef1ca9978e60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_1baabe4e3ab945811b08196d0e77de10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_890a5e246b1cd8b9cc0cea4f9a97991f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_8069cd6f049df38efe068cbc7acc6b38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383514,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_77c189a92a060aa6015b5b0a015e5ad1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fbdb8be-a155-52e5-908e-73e7f9e9a06c/1fbdb8be-a155-52e5-908e-73e7f9e9a06c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/a0/b1a0bdb657da2e0a25c69f8f17086fcd/pa/DM24490_5a8f2b9a36311612aa5c4b647014ef4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2019}
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-28 20:32:28 [auto1.be] INFO: Saving data for DM24490: {'created_time': 1774729948.711558, 'last_price_update_time': 1774729948.711569, 'auction_closing_time': 1774883939.0}
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM24490') HTTP/1.1" 204 0
2026-03-28 20:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 with identifier: NJ37001
2026-03-28 20:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 with identifier: NJ37001
2026-03-28 20:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8430c6d-c0ef-5400-a1a7-8f6d8af11b41 with identifier: NJ37001 to the API
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:43Z',
 'fuel_type': 'diesel',
 'id': 'd8430c6d-c0ef-5400-a1a7-8f6d8af11b41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ37001',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 127648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1dfb8a6f216c3f6654ddcf4f41319c1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 649685,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_efb1e5e43b16bad783988ae9707ed978.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_1b687b3a46d57ae7bc56bea7c83fc153.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_cb5b4f8072ecb848042a988ff2da1ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561631,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_17ecc497638089413b010f225649f95a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 607138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_3928642e5e1a1248ecaef3cb6fcc9109.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_13a5bd32c81e985c5514fe51c541f18a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 722310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_35a933267e51b7e3795e908e8bec366b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 602057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_0286e0e81fcbb3387121c624787daddc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8430c6d-c0ef-5400-a1a7-8f6d8af11b41/d8430c6d-c0ef-5400-a1a7-8f6d8af11b41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img34/15/34151b2e6626f239129c2b6a78929b5b/pa/NJ37001_736539a590995a21e98168a281b3ad63.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 CDTI DPF Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ37001%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [auto1.be] INFO: Saving data for NJ37001: {'created_time': 1774729949.100094, 'last_price_update_time': 1774729949.100104, 'auction_closing_time': 1774886143.0}
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ37001') HTTP/1.1" 204 0
2026-03-28 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b591e28c2d0e9b3420b98aede4faa97d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM51411> (referer: https://www.auto1.com/v1/car-details-view/MM51411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM05161> (referer: https://www.auto1.com/v1/car-details-view/EM05161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f13ad0>
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_8dc5b7275badd41f291c8536019f2c60.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_8dc5b7275badd41f291c8536019f2c60.jpg saved to cache
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726abe10>
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_44ef047a9e8d9a952c82ed4171e54e90.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_44ef047a9e8d9a952c82ed4171e54e90.jpg saved to cache
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD88013> (referer: https://www.auto1.com/v1/car-details-view/KD88013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_349c01163ae7871952bfb086b03c5f0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17314cf50>
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_b591e28c2d0e9b3420b98aede4faa97d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b591e28c2d0e9b3420b98aede4faa97d.jpg saved to cache
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411
2026-03-28 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e46d563-73d9-516a-8e04-7806d7e488c7 with scrape type 1
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg not downloaded yet
2026-03-28 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161
2026-03-28 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c875d288-7127-58c9-8e16-0a9db6f2af22 with scrape type 1
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_8ee1514d63c74bf91500d797e08c1559.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_8ee1514d63c74bf91500d797e08c1559.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_2e8a5b4c337d7ac8a90d13258b59aefd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_2e8a5b4c337d7ac8a90d13258b59aefd.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_cd813ea9df39b0a388ffcf34faed6c96.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_cd813ea9df39b0a388ffcf34faed6c96.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_b378d1e3ba2c35d294484fec128be387.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b378d1e3ba2c35d294484fec128be387.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_96f9c225ff0ef912d9490f294c7df687.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_96f9c225ff0ef912d9490f294c7df687.jpg not downloaded yet
2026-03-28 20:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013
2026-03-28 20:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c958f8e7-3b3a-5bc5-a61a-08eebae96932 with scrape type 1
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg not downloaded yet
2026-03-28 20:32:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17268abd0>
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_349c01163ae7871952bfb086b03c5f0c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_349c01163ae7871952bfb086b03c5f0c.jpg saved to cache
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_624d7f97aaf13ce5b3a0894e7ca76a5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_624d7f97aaf13ce5b3a0894e7ca76a5c.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_ff3283aaeb29c074daf2f710858fb4b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_ff3283aaeb29c074daf2f710858fb4b7.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_fcb20dc8075d3c612a4addfbf1da2ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_fcb20dc8075d3c612a4addfbf1da2ec8.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_978a8d57bb31c29906b16ad852777a95.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_978a8d57bb31c29906b16ad852777a95.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_d924f88daf7b747c6451067fb4cbb947.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_d924f88daf7b747c6451067fb4cbb947.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_d0a67d877a24fe4af2a5a332d66477bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_d0a67d877a24fe4af2a5a332d66477bf.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_93e2bd64244d7d2f7ad7ff001215932f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_93e2bd64244d7d2f7ad7ff001215932f.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_66bf23387578f8ed0bdc4ccb8b6916b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_66bf23387578f8ed0bdc4ccb8b6916b1.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_5dc139bbd063534c0873e1d879146962.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_5dc139bbd063534c0873e1d879146962.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_bce31ce1156503aecc44e985b6beb56a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_bce31ce1156503aecc44e985b6beb56a.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_7f12040a980876a5fed7f1f706246bfc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_7f12040a980876a5fed7f1f706246bfc.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_9bcc4ff5385a91b954819715add053da.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_9bcc4ff5385a91b954819715add053da.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_80a9a7109acd91d629b4684ed02064b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_80a9a7109acd91d629b4684ed02064b7.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_e8d5044c7e2b69fddb8ce3da89cd1dc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_e8d5044c7e2b69fddb8ce3da89cd1dc6.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_e74a5cb1f768b68de8a748d7fae37398.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_e74a5cb1f768b68de8a748d7fae37398.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_fc32afc209ef4f9c9db94cbe59d39871.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_fc32afc209ef4f9c9db94cbe59d39871.jpg not downloaded yet
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_a779d0cba861d260a814844395af3801.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_a779d0cba861d260a814844395af3801.jpg not downloaded yet
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_d68e130779101442b6d4991cb6ca6b61.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_d68e130779101442b6d4991cb6ca6b61.jpg not downloaded yet
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_9114fa6f4f13b397f608d9baef75309d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_9114fa6f4f13b397f608d9baef75309d.jpg not downloaded yet
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_bb080539204bb7d7a744ebb8704a775d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM87207> (referer: https://www.auto1.com/v1/car-details-view/PM87207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_27bdf165eade819eea60f12e5d58afb9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_69c2bb4b1020919b29458855cb0aed52.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA04427> (referer: https://www.auto1.com/v1/car-details-view/FA04427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP44577> (referer: https://www.auto1.com/v1/car-details-view/DP44577/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731b0e50>
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fe0%252Fc7e0804b49c48e4ad1f82a0343db929a%252Fpa%252FYY44687_bb080539204bb7d7a744ebb8704a775d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_bb080539204bb7d7a744ebb8704a775d.jpg saved to cache
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bdb769a-0e22-516c-aee5-02d7c62683f1
2026-03-28 20:32:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bdb769a-0e22-516c-aee5-02d7c62683f1, skipping ID generation
2026-03-28 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdb769a-0e22-516c-aee5-02d7c62683f1 with scrape type 1
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bdb769a-0e22-516c-aee5-02d7c62683f1 sending to next pipeline
2026-03-28 20:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5bdb769a-0e22-516c-aee5-02d7c62683f1, identifier: YY44687
2026-03-28 20:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687
2026-03-28 20:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687
2026-03-28 20:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687 to the API
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_bb080539204bb7d7a744ebb8704a775d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:29:19Z',
 'fuel_type': 'petrol',
 'id': '5bdb769a-0e22-516c-aee5-02d7c62683f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY44687',
 'listing': 'auction',
 'location': 'BE, Rochefort',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 82738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_762c0e10a9c9d236c05b214e86094f96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2423853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2ae3ebc0b7076f9089e9d497106a840d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b4fb94adfacd94258ae77537a046602e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_cada49e985e003ecdc59555a8ac6c963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_2f0e837743c542e80bd4bc344e6e28bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325779,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_bb080539204bb7d7a744ebb8704a775d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_835c8dcf5ab6930c8f3c626dcbd69c12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2294453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_349c01163ae7871952bfb086b03c5f0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_b591e28c2d0e9b3420b98aede4faa97d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bdb769a-0e22-516c-aee5-02d7c62683f1/5bdb769a-0e22-516c-aee5-02d7c62683f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/e0/c7e0804b49c48e4ad1f82a0343db929a/pa/YY44687_356b1446116d00233d325d5b9e1c46a0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-28 20:32:30 [auto1.be] INFO: Saving data for YY44687: {'created_time': 1774729950.713936, 'last_price_update_time': 1774729950.713946, 'auction_closing_time': 1774884559.0}
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YY44687') HTTP/1.1" 204 0
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_9114fa6f4f13b397f608d9baef75309d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207
2026-03-28 20:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02338559-0b33-5b9d-b66c-1ac2772b474f with scrape type 1
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_83c718d07fbc0c5c7dbd8c5a9dc4dab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_83c718d07fbc0c5c7dbd8c5a9dc4dab6.jpg not downloaded yet
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_d68e130779101442b6d4991cb6ca6b61.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_08b3b5a9270f28dc885e5b5215aae5c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_08b3b5a9270f28dc885e5b5215aae5c0.jpg not downloaded yet
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY14877/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA99224/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW19918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN49517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726eb690>
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_27bdf165eade819eea60f12e5d58afb9.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_27bdf165eade819eea60f12e5d58afb9.jpg saved to cache
2026-03-28 20:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721a0550>
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_69c2bb4b1020919b29458855cb0aed52.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_69c2bb4b1020919b29458855cb0aed52.jpg saved to cache
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17317d4d0>
2026-03-28 20:32:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fd3%252Fa9d38755be931cf51a632ae5f2cc7c16%252Fpa%252FXW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg saved to cache
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c0f2cb4-1123-521d-b42d-39ab21270083
2026-03-28 20:32:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c0f2cb4-1123-521d-b42d-39ab21270083, skipping ID generation
2026-03-28 20:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0f2cb4-1123-521d-b42d-39ab21270083 with scrape type 1
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c0f2cb4-1123-521d-b42d-39ab21270083 sending to next pipeline
2026-03-28 20:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c0f2cb4-1123-521d-b42d-39ab21270083, identifier: XW30503
2026-03-28 20:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1493dc8-ea1d-547f-836d-f35a1e966e1e with identifier: FA04427
2026-03-28 20:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1493dc8-ea1d-547f-836d-f35a1e966e1e with scrape type 1
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_2a4e64be09b2c33fb1e91226223b499f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_2a4e64be09b2c33fb1e91226223b499f.jpg not downloaded yet
2026-03-28 20:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577
2026-03-28 20:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689b1517-263a-589b-abf0-a8f06331dc85 with scrape type 1
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_977612e4e696f3492404c0de9aade0bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_977612e4e696f3492404c0de9aade0bd.jpg not downloaded yet
2026-03-28 20:32:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503
2026-03-28 20:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503
2026-03-28 20:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503 to the API
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:18:49Z',
 'fuel_type': 'hybrid',
 'id': '3c0f2cb4-1123-521d-b42d-39ab21270083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW30503',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 138252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_69c2bb4b1020919b29458855cb0aed52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_7f87f090a189d49554f98197b398eac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525867,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_468b39ed4c8dd206e888e1bbcf6fc43d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_4cdfdcff2437d4bdf25c3b4f00736862.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_27bdf165eade819eea60f12e5d58afb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_44ef047a9e8d9a952c82ed4171e54e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_8dc5b7275badd41f291c8536019f2c60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_0c15ed86d6e22229b06e54ba35ed011f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_aa8037ed669927912b5138fc6b61035a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c0f2cb4-1123-521d-b42d-39ab21270083/3c0f2cb4-1123-521d-b42d-39ab21270083_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/d3/a9d38755be931cf51a632ae5f2cc7c16/pa/XW30503_1965eb1955abd265b079dc4392a270cd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-28 20:32:31 [auto1.be] INFO: Saving data for XW30503: {'created_time': 1774729951.972752, 'last_price_update_time': 1774729951.972762, 'auction_closing_time': 1774883929.0}
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XW30503') HTTP/1.1" 204 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_f84190cdf380184f37e58bab281155d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_f84190cdf380184f37e58bab281155d9.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_56804e2793184cb9c56e9c82d31f03d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_56804e2793184cb9c56e9c82d31f03d4.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_1a8451a843ac0d1a82949656b3f21a89.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_1a8451a843ac0d1a82949656b3f21a89.jpg not downloaded yet
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE30988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17313fad0>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_9114fa6f4f13b397f608d9baef75309d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_9114fa6f4f13b397f608d9baef75309d.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725615d0>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_d68e130779101442b6d4991cb6ca6b61.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_d68e130779101442b6d4991cb6ca6b61.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_bcf25371c2a104f18a08f88adc270f26.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_bcf25371c2a104f18a08f88adc270f26.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_aa49b821de51fafc146b73ae2e6a4162.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_aa49b821de51fafc146b73ae2e6a4162.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_117e091e64193d509982ca3baf511b3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_117e091e64193d509982ca3baf511b3a.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_b695dea8e002f1cca1647b3393aa863d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_b695dea8e002f1cca1647b3393aa863d.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_6c2e22ad636c4d74292e8b71391fa6bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_6c2e22ad636c4d74292e8b71391fa6bb.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_5d756dcc2ca82b633f8127f415b52c01.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_5d756dcc2ca82b633f8127f415b52c01.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_be7bb9c18d1195194fdd5c23674cd5ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_be7bb9c18d1195194fdd5c23674cd5ba.jpg not downloaded yet
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_83c718d07fbc0c5c7dbd8c5a9dc4dab6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_1a8451a843ac0d1a82949656b3f21a89.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_977612e4e696f3492404c0de9aade0bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_56697e0670aae73ac6932a46523ad5af.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_56697e0670aae73ac6932a46523ad5af.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_115efed75556141058200e05e20e916c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_115efed75556141058200e05e20e916c.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_941ee7334069e5803f8601f16217be80.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_941ee7334069e5803f8601f16217be80.jpg not downloaded yet
2026-03-28 20:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_1036acd0a70376874de355ed6035ccaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_1036acd0a70376874de355ed6035ccaf.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_9a09d2fe5df46a0118cfe8bc4204aa0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_9a09d2fe5df46a0118cfe8bc4204aa0f.jpg not downloaded yet
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_08b3b5a9270f28dc885e5b5215aae5c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_be8e3917ebde68b5649d8793654ffd92.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_be8e3917ebde68b5649d8793654ffd92.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_3d7a3203e513064a0159a3e436a0bd0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_3d7a3203e513064a0159a3e436a0bd0a.jpg not downloaded yet
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_2a4e64be09b2c33fb1e91226223b499f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172697d10>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_83c718d07fbc0c5c7dbd8c5a9dc4dab6.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_83c718d07fbc0c5c7dbd8c5a9dc4dab6.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173022750>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_1a8451a843ac0d1a82949656b3f21a89.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_1a8451a843ac0d1a82949656b3f21a89.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308db50>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_977612e4e696f3492404c0de9aade0bd.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_977612e4e696f3492404c0de9aade0bd.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_b7dc60bdcb5d7a39db5d3a6fd66846a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_b7dc60bdcb5d7a39db5d3a6fd66846a5.jpg not downloaded yet
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_0795d680718e93a69f95bc40e5c30d5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_0795d680718e93a69f95bc40e5c30d5e.jpg not downloaded yet
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_e74a5cb1f768b68de8a748d7fae37398.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_fc32afc209ef4f9c9db94cbe59d39871.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_20b2b63c104a5dd31bd7d9650604a460.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_20b2b63c104a5dd31bd7d9650604a460.jpg not downloaded yet
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ26705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_80a9a7109acd91d629b4684ed02064b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_be7bb9c18d1195194fdd5c23674cd5ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17918aed0>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_08b3b5a9270f28dc885e5b5215aae5c0.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_08b3b5a9270f28dc885e5b5215aae5c0.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa186de49d0>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_2a4e64be09b2c33fb1e91226223b499f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_2a4e64be09b2c33fb1e91226223b499f.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG83875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_941ee7334069e5803f8601f16217be80.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308c110>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_e74a5cb1f768b68de8a748d7fae37398.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_e74a5cb1f768b68de8a748d7fae37398.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172173690>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_fc32afc209ef4f9c9db94cbe59d39871.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_fc32afc209ef4f9c9db94cbe59d39871.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17256ff10>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_80a9a7109acd91d629b4684ed02064b7.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_80a9a7109acd91d629b4684ed02064b7.jpg saved to cache
2026-03-28 20:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173161590>
2026-03-28 20:32:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_be7bb9c18d1195194fdd5c23674cd5ba.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_be7bb9c18d1195194fdd5c23674cd5ba.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_9a09d2fe5df46a0118cfe8bc4204aa0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM29446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173161b10>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_941ee7334069e5803f8601f16217be80.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_941ee7334069e5803f8601f16217be80.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_5d756dcc2ca82b633f8127f415b52c01.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_0795d680718e93a69f95bc40e5c30d5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_a779d0cba861d260a814844395af3801.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_f84190cdf380184f37e58bab281155d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_56804e2793184cb9c56e9c82d31f03d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_e8d5044c7e2b69fddb8ce3da89cd1dc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17210ee10>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_9a09d2fe5df46a0118cfe8bc4204aa0f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_9a09d2fe5df46a0118cfe8bc4204aa0f.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_3d7a3203e513064a0159a3e436a0bd0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_20b2b63c104a5dd31bd7d9650604a460.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_115efed75556141058200e05e20e916c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17300c590>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_5d756dcc2ca82b633f8127f415b52c01.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_5d756dcc2ca82b633f8127f415b52c01.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_be8e3917ebde68b5649d8793654ffd92.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_b695dea8e002f1cca1647b3393aa863d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK23104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173190fd0>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_0795d680718e93a69f95bc40e5c30d5e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_0795d680718e93a69f95bc40e5c30d5e.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17303cc10>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_a779d0cba861d260a814844395af3801.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_a779d0cba861d260a814844395af3801.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732bc750>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_f84190cdf380184f37e58bab281155d9.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_f84190cdf380184f37e58bab281155d9.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725279d0>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_56804e2793184cb9c56e9c82d31f03d4.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_56804e2793184cb9c56e9c82d31f03d4.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17303f9d0>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_e8d5044c7e2b69fddb8ce3da89cd1dc6.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_e8d5044c7e2b69fddb8ce3da89cd1dc6.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17303c290>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_3d7a3203e513064a0159a3e436a0bd0a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_3d7a3203e513064a0159a3e436a0bd0a.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216ddd0>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_20b2b63c104a5dd31bd7d9650604a460.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_20b2b63c104a5dd31bd7d9650604a460.jpg saved to cache
2026-03-28 20:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216fad0>
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_115efed75556141058200e05e20e916c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_115efed75556141058200e05e20e916c.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE30988> (referer: https://www.auto1.com/v1/car-details-view/BE30988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172617d10>
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_be8e3917ebde68b5649d8793654ffd92.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_be8e3917ebde68b5649d8793654ffd92.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f13210>
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_b695dea8e002f1cca1647b3393aa863d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_b695dea8e002f1cca1647b3393aa863d.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ26705> (referer: https://www.auto1.com/v1/car-details-view/VZ26705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988
2026-03-28 20:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69dae1ce-8e8b-594b-a85c-20d168195f3e with scrape type 1
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_db0857e841472c9cb5b6d13d12a6c5da.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_db0857e841472c9cb5b6d13d12a6c5da.jpg not downloaded yet
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_98262f2912c1ddc03da663981cb8dbe6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_98262f2912c1ddc03da663981cb8dbe6.jpg not downloaded yet
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_56697e0670aae73ac6932a46523ad5af.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_117e091e64193d509982ca3baf511b3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_b7dc60bdcb5d7a39db5d3a6fd66846a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_daefb7192fa7a24b819eff4d9ad43ac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_daefb7192fa7a24b819eff4d9ad43ac5.jpg not downloaded yet
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_f22e00e16c1a7d31fa5c078798b9e161.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_f22e00e16c1a7d31fa5c078798b9e161.jpg not downloaded yet
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_6c2e22ad636c4d74292e8b71391fa6bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_8a37e0efb70ea7bc36b070db162a147e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_8a37e0efb70ea7bc36b070db162a147e.jpg not downloaded yet
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705
2026-03-28 20:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4da4e87-702d-5e2a-9f51-40772ebd97d7 with scrape type 1
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_b6127ed7ba0d3c63daf547050ce527f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_b6127ed7ba0d3c63daf547050ce527f2.jpg not downloaded yet
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_402be44361a273660d0079a94d97185d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_402be44361a273660d0079a94d97185d.jpg not downloaded yet
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_db0857e841472c9cb5b6d13d12a6c5da.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_9bcc4ff5385a91b954819715add053da.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_9c984cfc1431362728f6001197d1a2d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_9c984cfc1431362728f6001197d1a2d1.jpg not downloaded yet
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_9a3405ba9633e3de02e8045652521d39.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_9a3405ba9633e3de02e8045652521d39.jpg not downloaded yet
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_c0c4b6277198838d1db90522601969de.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c0c4b6277198838d1db90522601969de.jpg not downloaded yet
2026-03-28 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172141f10>
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_56697e0670aae73ac6932a46523ad5af.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_56697e0670aae73ac6932a46523ad5af.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172573f90>
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_117e091e64193d509982ca3baf511b3a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_117e091e64193d509982ca3baf511b3a.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17329ce90>
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_b7dc60bdcb5d7a39db5d3a6fd66846a5.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_b7dc60bdcb5d7a39db5d3a6fd66846a5.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fe3790>
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F38%252Fec38e70a8fa816311473acb4a44decf0%252Fpa%252FDP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg saved to cache
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 689b1517-263a-589b-abf0-a8f06331dc85
2026-03-28 20:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 689b1517-263a-589b-abf0-a8f06331dc85, skipping ID generation
2026-03-28 20:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689b1517-263a-589b-abf0-a8f06331dc85 with scrape type 1
2026-03-28 20:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 689b1517-263a-589b-abf0-a8f06331dc85 sending to next pipeline
2026-03-28 20:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 689b1517-263a-589b-abf0-a8f06331dc85, identifier: DP44577
2026-03-28 20:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_1036acd0a70376874de355ed6035ccaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_d9a7b940923e3f635674351064209dba.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_d9a7b940923e3f635674351064209dba.jpg not downloaded yet
2026-03-28 20:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577
2026-03-28 20:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577
2026-03-28 20:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577 to the API
2026-03-28 20:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:58:17Z',
 'fuel_type': 'petrol',
 'id': '689b1517-263a-589b-abf0-a8f06331dc85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP44577',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 132711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_977612e4e696f3492404c0de9aade0bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_1a8451a843ac0d1a82949656b3f21a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_6e049317b4ede358d6ccf8c3980c64f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_b695dea8e002f1cca1647b3393aa863d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_be7bb9c18d1195194fdd5c23674cd5ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689b1517-263a-589b-abf0-a8f06331dc85/689b1517-263a-589b-abf0-a8f06331dc85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/38/ec38e70a8fa816311473acb4a44decf0/pa/DP44577_941ee7334069e5803f8601f16217be80.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-28 20:32:36 [auto1.be] INFO: Saving data for DP44577: {'created_time': 1774729956.016615, 'last_price_update_time': 1774729956.016627, 'auction_closing_time': 1774886297.0}
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP44577') HTTP/1.1" 204 0
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_c028ddfc82513c413aa5c0f7522ef3de.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c028ddfc82513c413aa5c0f7522ef3de.jpg not downloaded yet
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_1c6833628b010fdd439e775469879492.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_1c6833628b010fdd439e775469879492.jpg not downloaded yet
2026-03-28 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW19918> (referer: https://www.auto1.com/v1/car-details-view/GW19918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY14877> (referer: https://www.auto1.com/v1/car-details-view/UY14877/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG83875> (referer: https://www.auto1.com/v1/car-details-view/SG83875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff9f10>
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_6c2e22ad636c4d74292e8b71391fa6bb.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_6c2e22ad636c4d74292e8b71391fa6bb.jpg saved to cache
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172670450>
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113ae03c1236f4a1d15ff21871967e0a%252Fpa%252FFA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg saved to cache
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1493dc8-ea1d-547f-836d-f35a1e966e1e
2026-03-28 20:32:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1493dc8-ea1d-547f-836d-f35a1e966e1e, skipping ID generation
2026-03-28 20:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1493dc8-ea1d-547f-836d-f35a1e966e1e with scrape type 1
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1493dc8-ea1d-547f-836d-f35a1e966e1e sending to next pipeline
2026-03-28 20:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1493dc8-ea1d-547f-836d-f35a1e966e1e, identifier: FA04427
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731b14d0>
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_db0857e841472c9cb5b6d13d12a6c5da.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_db0857e841472c9cb5b6d13d12a6c5da.jpg saved to cache
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731cf550>
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_9bcc4ff5385a91b954819715add053da.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_9bcc4ff5385a91b954819715add053da.jpg saved to cache
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_fb466cefa1c7a16dd15ab7b2fb4bbc7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_fb466cefa1c7a16dd15ab7b2fb4bbc7b.jpg not downloaded yet
2026-03-28 20:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1493dc8-ea1d-547f-836d-f35a1e966e1e with identifier: FA04427
2026-03-28 20:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1493dc8-ea1d-547f-836d-f35a1e966e1e with identifier: FA04427
2026-03-28 20:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1493dc8-ea1d-547f-836d-f35a1e966e1e with identifier: FA04427 to the API
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:25:00Z',
 'fuel_type': 'petrol',
 'id': 'a1493dc8-ea1d-547f-836d-f35a1e966e1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA04427',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 44949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397024,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_2a4e64be09b2c33fb1e91226223b499f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_56804e2793184cb9c56e9c82d31f03d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_ffb0a068a4a98aa83e28248aab3305b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_117e091e64193d509982ca3baf511b3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386295,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_5d756dcc2ca82b633f8127f415b52c01.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 381845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_115efed75556141058200e05e20e916c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_9a09d2fe5df46a0118cfe8bc4204aa0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2584183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_3d7a3203e513064a0159a3e436a0bd0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_0795d680718e93a69f95bc40e5c30d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1493dc8-ea1d-547f-836d-f35a1e966e1e/a1493dc8-ea1d-547f-836d-f35a1e966e1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113ae03c1236f4a1d15ff21871967e0a/pa/FA04427_20b2b63c104a5dd31bd7d9650604a460.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA04427%27 HTTP/1.1" 200 None
2026-03-28 20:32:36 [auto1.be] INFO: Saving data for FA04427: {'created_time': 1774729956.944857, 'last_price_update_time': 1774729956.944867, 'auction_closing_time': 1774884300.0}
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA04427') HTTP/1.1" 204 0
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_b605929f78548789e8f6bdcd4dbae1d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_b605929f78548789e8f6bdcd4dbae1d8.jpg not downloaded yet
2026-03-28 20:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA99224> (referer: https://www.auto1.com/v1/car-details-view/LA99224/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172673710>
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_1036acd0a70376874de355ed6035ccaf.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_1036acd0a70376874de355ed6035ccaf.jpg saved to cache
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg not downloaded yet
2026-03-28 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM29446> (referer: https://www.auto1.com/v1/car-details-view/UM29446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918
2026-03-28 20:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063483d3-546a-5f9f-98e0-f9f8aa002783 with scrape type 1
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 063483d3-546a-5f9f-98e0-f9f8aa002783
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_fede1b8d087a1d199ad91e9e55c39968.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_fede1b8d087a1d199ad91e9e55c39968.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_6121cc799e44826c9888487b01b33872.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_6121cc799e44826c9888487b01b33872.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_4bb78877b296262b6ae6c56677bbdd7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_4bb78877b296262b6ae6c56677bbdd7a.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_50104c7969a8e668a69175c394748678.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_50104c7969a8e668a69175c394748678.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_5c557edeeb860d7eb520af5c148f6bc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_5c557edeeb860d7eb520af5c148f6bc2.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_7cd13fa2358e2356a00f5a4bf88a5fc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_7cd13fa2358e2356a00f5a4bf88a5fc4.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_1396cffa4a5a15dac539022c509b8c83.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_1396cffa4a5a15dac539022c509b8c83.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_78a2ac9c9bc0294d18f206515ca596f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_78a2ac9c9bc0294d18f206515ca596f2.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_d8348c361315164000e6c5d218fa5f8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_d8348c361315164000e6c5d218fa5f8c.jpg already downloaded
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fc2%252Fa5c258a2feb7143d2762043260f112fd%252Fpa%252FGW19918_f545b39ebf28d4f97dd12cfb80a962f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_f545b39ebf28d4f97dd12cfb80a962f9.jpg already downloaded
2026-03-28 20:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 063483d3-546a-5f9f-98e0-f9f8aa002783, identifier: GW19918
2026-03-28 20:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877
2026-03-28 20:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with scrape type 1
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_2953f03aba81a196d1e1fb8ef85d3542.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_2953f03aba81a196d1e1fb8ef85d3542.jpg not downloaded yet
2026-03-28 20:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875
2026-03-28 20:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8542210c-f5ac-5415-b439-19ad7e59dfa0 with scrape type 1
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_6ccfb30ac99e4f3ef9b99ddd45dd01a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_6ccfb30ac99e4f3ef9b99ddd45dd01a4.jpg not downloaded yet
2026-03-28 20:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918
2026-03-28 20:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918
2026-03-28 20:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918 to the API
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW19918>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:58:56Z',
 'fuel_type': 'hybrid',
 'id': '063483d3-546a-5f9f-98e0-f9f8aa002783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW19918',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 191954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_fede1b8d087a1d199ad91e9e55c39968.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_6121cc799e44826c9888487b01b33872.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_4bb78877b296262b6ae6c56677bbdd7a.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_50104c7969a8e668a69175c394748678.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_5c557edeeb860d7eb520af5c148f6bc2.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_7cd13fa2358e2356a00f5a4bf88a5fc4.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_1396cffa4a5a15dac539022c509b8c83.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_78a2ac9c9bc0294d18f206515ca596f2.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_d8348c361315164000e6c5d218fa5f8c.jpg',
                'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_f545b39ebf28d4f97dd12cfb80a962f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_fede1b8d087a1d199ad91e9e55c39968.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_6121cc799e44826c9888487b01b33872.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_4bb78877b296262b6ae6c56677bbdd7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_50104c7969a8e668a69175c394748678.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_5c557edeeb860d7eb520af5c148f6bc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2026636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_7cd13fa2358e2356a00f5a4bf88a5fc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2029440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_1396cffa4a5a15dac539022c509b8c83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2080831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_78a2ac9c9bc0294d18f206515ca596f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_d8348c361315164000e6c5d218fa5f8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063483d3-546a-5f9f-98e0-f9f8aa002783/063483d3-546a-5f9f-98e0-f9f8aa002783_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2722743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/c2/a5c258a2feb7143d2762043260f112fd/pa/GW19918_f545b39ebf28d4f97dd12cfb80a962f9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [auto1.be] INFO: Saving data for GW19918: {'created_time': 1774729957.908091, 'last_price_update_time': 1774729957.908102, 'auction_closing_time': 1774886336.0}
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW19918') HTTP/1.1" 204 0
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_897a07219b6570db5b5a1d2f36d35364.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_897a07219b6570db5b5a1d2f36d35364.jpg not downloaded yet
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_71144f8dfe92f0d958b8b2d0de24efe1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_71144f8dfe92f0d958b8b2d0de24efe1.jpg not downloaded yet
2026-03-28 20:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK23104> (referer: https://www.auto1.com/v1/car-details-view/XK23104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224
2026-03-28 20:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with scrape type 1
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d8169e1-25d8-53f3-9c58-1a9a099811a1
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_5df306756a08e359ac516c8f8c568569.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_5df306756a08e359ac516c8f8c568569.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_d031af0a976b2872e3c56d7c2b67cb12.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_d031af0a976b2872e3c56d7c2b67cb12.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_fefbacce3dfc028e45d6f14cea8a9dca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_fefbacce3dfc028e45d6f14cea8a9dca.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_497e0a5b3fb6db811c08ee757c50f7af.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_497e0a5b3fb6db811c08ee757c50f7af.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_7c0e511a450962698c09be374ac57a7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_7c0e511a450962698c09be374ac57a7f.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_60daa019f751e31bb89817092e541ede.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_60daa019f751e31bb89817092e541ede.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_b52c3f9b9386d920fd5810f0d5c1ee71.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_b52c3f9b9386d920fd5810f0d5c1ee71.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_9f8152c58c3f268542d5d232a6b38297.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_9f8152c58c3f268542d5d232a6b38297.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_f5d7b00ea50112ac24ba56c64822881e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_f5d7b00ea50112ac24ba56c64822881e.jpg already downloaded
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fbb%252Faabbc05c70dd249cdbb006429bfa0673%252Fpa%252FLA99224_1ae276bd080718b89b8a84f67c0c5f3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_1ae276bd080718b89b8a84f67c0c5f3b.jpg already downloaded
2026-03-28 20:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d8169e1-25d8-53f3-9c58-1a9a099811a1, identifier: LA99224
2026-03-28 20:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224
2026-03-28 20:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224 to the API
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA99224>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:54Z',
 'fuel_type': 'diesel',
 'id': '3d8169e1-25d8-53f3-9c58-1a9a099811a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA99224',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 198826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_5df306756a08e359ac516c8f8c568569.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_d031af0a976b2872e3c56d7c2b67cb12.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_fefbacce3dfc028e45d6f14cea8a9dca.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_497e0a5b3fb6db811c08ee757c50f7af.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_7c0e511a450962698c09be374ac57a7f.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_60daa019f751e31bb89817092e541ede.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_b52c3f9b9386d920fd5810f0d5c1ee71.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_9f8152c58c3f268542d5d232a6b38297.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_f5d7b00ea50112ac24ba56c64822881e.jpg',
                'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_1ae276bd080718b89b8a84f67c0c5f3b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_5df306756a08e359ac516c8f8c568569.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_d031af0a976b2872e3c56d7c2b67cb12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_fefbacce3dfc028e45d6f14cea8a9dca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_497e0a5b3fb6db811c08ee757c50f7af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_7c0e511a450962698c09be374ac57a7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_60daa019f751e31bb89817092e541ede.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_b52c3f9b9386d920fd5810f0d5c1ee71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_9f8152c58c3f268542d5d232a6b38297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_f5d7b00ea50112ac24ba56c64822881e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d8169e1-25d8-53f3-9c58-1a9a099811a1/3d8169e1-25d8-53f3-9c58-1a9a099811a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/bb/aabbc05c70dd249cdbb006429bfa0673/pa/LA99224_1ae276bd080718b89b8a84f67c0c5f3b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [auto1.be] INFO: Saving data for LA99224: {'created_time': 1774729958.869925, 'last_price_update_time': 1774729958.869937, 'auction_closing_time': 1774885374.0}
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA99224') HTTP/1.1" 204 0
2026-03-28 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c028ddfc82513c413aa5c0f7522ef3de.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_4428900488db1682b3cd488b5dc584ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_4428900488db1682b3cd488b5dc584ae.jpg not downloaded yet
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg not downloaded yet
2026-03-28 20:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446
2026-03-28 20:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf256247-d3d0-5776-8798-06a8b9b65eec with scrape type 1
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_9314852453d2596a20813878e6325860.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_9314852453d2596a20813878e6325860.jpg not downloaded yet
2026-03-28 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_fb466cefa1c7a16dd15ab7b2fb4bbc7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_d9a7b940923e3f635674351064209dba.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c0c4b6277198838d1db90522601969de.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_7df642b230ad2e2c29989f42a05733ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_7df642b230ad2e2c29989f42a05733ad.jpg not downloaded yet
2026-03-28 20:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_814a3e5f5887cd31a845496a6ab62417.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_814a3e5f5887cd31a845496a6ab62417.jpg not downloaded yet
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_10c5fec1b6526d4cf359563f6b9a809c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_10c5fec1b6526d4cf359563f6b9a809c.jpg not downloaded yet
2026-03-28 20:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104
2026-03-28 20:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with scrape type 1
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0d21d3d-637b-53c4-8c5c-55b1c2034ec9
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_752b7a0d60957f8c5f464113e6be2c5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_752b7a0d60957f8c5f464113e6be2c5b.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_4595a7974f0579a9292dbdf847bcde30.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_4595a7974f0579a9292dbdf847bcde30.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_d8e5169a976d809e986b56ed092e9c6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_d8e5169a976d809e986b56ed092e9c6f.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_f1b8949336dbb9a7f67a7c77624be1ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_f1b8949336dbb9a7f67a7c77624be1ec.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_cc5f315534a493b175e74581abe4c6fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_cc5f315534a493b175e74581abe4c6fd.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_27274a9bab9a67d041dbe0199c7bf601.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_27274a9bab9a67d041dbe0199c7bf601.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_6fd56e01574be00e40a87a28e2b65af1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_6fd56e01574be00e40a87a28e2b65af1.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_97f119c2ef1405e24475fc88c13866b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_97f119c2ef1405e24475fc88c13866b7.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_3a1136976a8123283579ca4aee02f695.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_3a1136976a8123283579ca4aee02f695.jpg already downloaded
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fea%252F01ea65968b00feb331f062660c229313%252Fpa%252FXK23104_638097f94e3e41b16caf6a918f817e9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_638097f94e3e41b16caf6a918f817e9c.jpg already downloaded
2026-03-28 20:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9, identifier: XK23104
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_b91a152c4a96e69f61eaeaa75a13acac.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b91a152c4a96e69f61eaeaa75a13acac.jpg not downloaded yet
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_7486e85720efa357d5d00a1a11cfc89c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_7486e85720efa357d5d00a1a11cfc89c.jpg not downloaded yet
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_4ce05de2805371a1df26b1299d2a7e52.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_4ce05de2805371a1df26b1299d2a7e52.jpg not downloaded yet
2026-03-28 20:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104
2026-03-28 20:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104
2026-03-28 20:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104 to the API
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK23104>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:15Z',
 'fuel_type': 'diesel',
 'id': 'c0d21d3d-637b-53c4-8c5c-55b1c2034ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK23104',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '5er',
 'odometer': 169092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_752b7a0d60957f8c5f464113e6be2c5b.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_4595a7974f0579a9292dbdf847bcde30.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_d8e5169a976d809e986b56ed092e9c6f.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_f1b8949336dbb9a7f67a7c77624be1ec.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_cc5f315534a493b175e74581abe4c6fd.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_27274a9bab9a67d041dbe0199c7bf601.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_6fd56e01574be00e40a87a28e2b65af1.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_97f119c2ef1405e24475fc88c13866b7.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_3a1136976a8123283579ca4aee02f695.jpg',
                'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_638097f94e3e41b16caf6a918f817e9c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_752b7a0d60957f8c5f464113e6be2c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_4595a7974f0579a9292dbdf847bcde30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_d8e5169a976d809e986b56ed092e9c6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_f1b8949336dbb9a7f67a7c77624be1ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_cc5f315534a493b175e74581abe4c6fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_27274a9bab9a67d041dbe0199c7bf601.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_6fd56e01574be00e40a87a28e2b65af1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_97f119c2ef1405e24475fc88c13866b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_3a1136976a8123283579ca4aee02f695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d21d3d-637b-53c4-8c5c-55b1c2034ec9/c0d21d3d-637b-53c4-8c5c-55b1c2034ec9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/ea/01ea65968b00feb331f062660c229313/pa/XK23104_638097f94e3e41b16caf6a918f817e9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 518d',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [auto1.be] INFO: Saving data for XK23104: {'created_time': 1774729959.73158, 'last_price_update_time': 1774729959.731597, 'auction_closing_time': 1774883355.0}
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK23104') HTTP/1.1" 204 0
2026-03-28 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_9c984cfc1431362728f6001197d1a2d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_402be44361a273660d0079a94d97185d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_b6127ed7ba0d3c63daf547050ce527f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_e78c5fb43d7b088fa123441d82347876.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e78c5fb43d7b088fa123441d82347876.jpg not downloaded yet
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_85c6170dea282c27181394884fff8b85.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_85c6170dea282c27181394884fff8b85.jpg not downloaded yet
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_3fb957ffe1e5c3ab8538121e69354b29.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_3fb957ffe1e5c3ab8538121e69354b29.jpg not downloaded yet
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172614390>
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_c028ddfc82513c413aa5c0f7522ef3de.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c028ddfc82513c413aa5c0f7522ef3de.jpg saved to cache
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fc8ed0>
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_fb466cefa1c7a16dd15ab7b2fb4bbc7b.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_fb466cefa1c7a16dd15ab7b2fb4bbc7b.jpg saved to cache
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a5150>
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_d9a7b940923e3f635674351064209dba.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_d9a7b940923e3f635674351064209dba.jpg saved to cache
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17316a790>
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_c0c4b6277198838d1db90522601969de.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c0c4b6277198838d1db90522601969de.jpg saved to cache
2026-03-28 20:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_b7ec83f6ff71d741bdd93cb55ad0e999.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b7ec83f6ff71d741bdd93cb55ad0e999.jpg not downloaded yet
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_56973a253e32102b284832051d65c167.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_56973a253e32102b284832051d65c167.jpg not downloaded yet
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_e94ba2b4333a81db7467bc3747055ba2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e94ba2b4333a81db7467bc3747055ba2.jpg not downloaded yet
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_a564b8bb947df4ef4321a9ed744878ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_a564b8bb947df4ef4321a9ed744878ae.jpg not downloaded yet
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff9c90>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_9c984cfc1431362728f6001197d1a2d1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_9c984cfc1431362728f6001197d1a2d1.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179429590>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_402be44361a273660d0079a94d97185d.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_402be44361a273660d0079a94d97185d.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172612890>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_b6127ed7ba0d3c63daf547050ce527f2.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_b6127ed7ba0d3c63daf547050ce527f2.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_8a37e0efb70ea7bc36b070db162a147e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_b605929f78548789e8f6bdcd4dbae1d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_98abf1547b66996dd4034540b0b4ee18.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_98abf1547b66996dd4034540b0b4ee18.jpg not downloaded yet
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_061fd6f6c761fc4cb5c3e488880549f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_061fd6f6c761fc4cb5c3e488880549f5.jpg not downloaded yet
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_1c6833628b010fdd439e775469879492.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_aa49b821de51fafc146b73ae2e6a4162.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_71144f8dfe92f0d958b8b2d0de24efe1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_33b16da3a4e8aff11c2079773a0be970.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_33b16da3a4e8aff11c2079773a0be970.jpg not downloaded yet
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_34abee9db68053d69d8722197d0d700e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_34abee9db68053d69d8722197d0d700e.jpg not downloaded yet
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_cd702887d8786f38d738aac9b865e681.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_cd702887d8786f38d738aac9b865e681.jpg not downloaded yet
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_6ccfb30ac99e4f3ef9b99ddd45dd01a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_d82ed33e98d640be86c5b5bb8e122410.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_d82ed33e98d640be86c5b5bb8e122410.jpg not downloaded yet
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173017150>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_8a37e0efb70ea7bc36b070db162a147e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_8a37e0efb70ea7bc36b070db162a147e.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172612a90>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_b605929f78548789e8f6bdcd4dbae1d8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_b605929f78548789e8f6bdcd4dbae1d8.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_4ce05de2805371a1df26b1299d2a7e52.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173293710>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_1c6833628b010fdd439e775469879492.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_1c6833628b010fdd439e775469879492.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173033cd0>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_aa49b821de51fafc146b73ae2e6a4162.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_aa49b821de51fafc146b73ae2e6a4162.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b5e90>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_71144f8dfe92f0d958b8b2d0de24efe1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_71144f8dfe92f0d958b8b2d0de24efe1.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721500d0>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_6ccfb30ac99e4f3ef9b99ddd45dd01a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_6ccfb30ac99e4f3ef9b99ddd45dd01a4.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_bcf25371c2a104f18a08f88adc270f26.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_897a07219b6570db5b5a1d2f36d35364.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_2953f03aba81a196d1e1fb8ef85d3542.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_7486e85720efa357d5d00a1a11cfc89c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173162f50>
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F6c%252F5f6cc56746fc27c005e87ec0a1742940%252Fpa%252FVZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg saved to cache
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4da4e87-702d-5e2a-9f51-40772ebd97d7
2026-03-28 20:32:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4da4e87-702d-5e2a-9f51-40772ebd97d7, skipping ID generation
2026-03-28 20:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4da4e87-702d-5e2a-9f51-40772ebd97d7 with scrape type 1
2026-03-28 20:32:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4da4e87-702d-5e2a-9f51-40772ebd97d7 sending to next pipeline
2026-03-28 20:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d4da4e87-702d-5e2a-9f51-40772ebd97d7, identifier: VZ26705
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17256e690>
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_4ce05de2805371a1df26b1299d2a7e52.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_4ce05de2805371a1df26b1299d2a7e52.jpg saved to cache
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_a564b8bb947df4ef4321a9ed744878ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705
2026-03-28 20:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705
2026-03-28 20:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705 to the API
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:06Z',
 'fuel_type': 'diesel',
 'id': 'd4da4e87-702d-5e2a-9f51-40772ebd97d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ26705',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 203168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_b6127ed7ba0d3c63daf547050ce527f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_9c984cfc1431362728f6001197d1a2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c0c4b6277198838d1db90522601969de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_c028ddfc82513c413aa5c0f7522ef3de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_fb466cefa1c7a16dd15ab7b2fb4bbc7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4da4e87-702d-5e2a-9f51-40772ebd97d7/d4da4e87-702d-5e2a-9f51-40772ebd97d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/6c/5f6cc56746fc27c005e87ec0a1742940/pa/VZ26705_7995b682933e31d6d2c4c79c0874fc58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2008}
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-28 20:32:41 [auto1.be] INFO: Saving data for VZ26705: {'created_time': 1774729961.44872, 'last_price_update_time': 1774729961.448731, 'auction_closing_time': 1774883946.0}
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ26705') HTTP/1.1" 204 0
2026-03-28 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b91a152c4a96e69f61eaeaa75a13acac.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_56973a253e32102b284832051d65c167.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173f64410>
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Ff2%252F73f2916dce73587e5de2c94d5945416f%252Fpa%252FPM87207_bcf25371c2a104f18a08f88adc270f26.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_bcf25371c2a104f18a08f88adc270f26.jpg saved to cache
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02338559-0b33-5b9d-b66c-1ac2772b474f
2026-03-28 20:32:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02338559-0b33-5b9d-b66c-1ac2772b474f, skipping ID generation
2026-03-28 20:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02338559-0b33-5b9d-b66c-1ac2772b474f with scrape type 1
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02338559-0b33-5b9d-b66c-1ac2772b474f sending to next pipeline
2026-03-28 20:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 02338559-0b33-5b9d-b66c-1ac2772b474f, identifier: PM87207
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f36910>
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_897a07219b6570db5b5a1d2f36d35364.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_897a07219b6570db5b5a1d2f36d35364.jpg saved to cache
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d8510>
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_2953f03aba81a196d1e1fb8ef85d3542.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_2953f03aba81a196d1e1fb8ef85d3542.jpg saved to cache
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173055a50>
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_7486e85720efa357d5d00a1a11cfc89c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_7486e85720efa357d5d00a1a11cfc89c.jpg saved to cache
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179155190>
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_a564b8bb947df4ef4321a9ed744878ae.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_a564b8bb947df4ef4321a9ed744878ae.jpg saved to cache
2026-03-28 20:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207
2026-03-28 20:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207
2026-03-28 20:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207 to the API
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_bcf25371c2a104f18a08f88adc270f26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '02338559-0b33-5b9d-b66c-1ac2772b474f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM87207',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 91555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_83c718d07fbc0c5c7dbd8c5a9dc4dab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_08b3b5a9270f28dc885e5b5215aae5c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2278746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_f84190cdf380184f37e58bab281155d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2473807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_bcf25371c2a104f18a08f88adc270f26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2286937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_aa49b821de51fafc146b73ae2e6a4162.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2305152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_6c2e22ad636c4d74292e8b71391fa6bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_56697e0670aae73ac6932a46523ad5af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_1036acd0a70376874de355ed6035ccaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_be8e3917ebde68b5649d8793654ffd92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02338559-0b33-5b9d-b66c-1ac2772b474f/02338559-0b33-5b9d-b66c-1ac2772b474f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/f2/73f2916dce73587e5de2c94d5945416f/pa/PM87207_b7dc60bdcb5d7a39db5d3a6fd66846a5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-28 20:32:42 [auto1.be] INFO: Saving data for PM87207: {'created_time': 1774729962.292999, 'last_price_update_time': 1774729962.29301, 'auction_closing_time': 1774886102.0}
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM87207') HTTP/1.1" 204 0
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_98abf1547b66996dd4034540b0b4ee18.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e94ba2b4333a81db7467bc3747055ba2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_34abee9db68053d69d8722197d0d700e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_cd702887d8786f38d738aac9b865e681.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17263ff10>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_b91a152c4a96e69f61eaeaa75a13acac.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b91a152c4a96e69f61eaeaa75a13acac.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731ec750>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_56973a253e32102b284832051d65c167.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_56973a253e32102b284832051d65c167.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730321d0>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_98abf1547b66996dd4034540b0b4ee18.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_98abf1547b66996dd4034540b0b4ee18.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172143210>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_e94ba2b4333a81db7467bc3747055ba2.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e94ba2b4333a81db7467bc3747055ba2.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c4550>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_34abee9db68053d69d8722197d0d700e.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_34abee9db68053d69d8722197d0d700e.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173115410>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_cd702887d8786f38d738aac9b865e681.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_cd702887d8786f38d738aac9b865e681.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_3fb957ffe1e5c3ab8538121e69354b29.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_85c6170dea282c27181394884fff8b85.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_9a3405ba9633e3de02e8045652521d39.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_f22e00e16c1a7d31fa5c078798b9e161.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_061fd6f6c761fc4cb5c3e488880549f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_d82ed33e98d640be86c5b5bb8e122410.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b7ec83f6ff71d741bdd93cb55ad0e999.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_33b16da3a4e8aff11c2079773a0be970.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_4428900488db1682b3cd488b5dc584ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_814a3e5f5887cd31a845496a6ab62417.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_daefb7192fa7a24b819eff4d9ad43ac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c5c50>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_3fb957ffe1e5c3ab8538121e69354b29.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_3fb957ffe1e5c3ab8538121e69354b29.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731913d0>
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_85c6170dea282c27181394884fff8b85.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_85c6170dea282c27181394884fff8b85.jpg saved to cache
2026-03-28 20:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e78c5fb43d7b088fa123441d82347876.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_10c5fec1b6526d4cf359563f6b9a809c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c6e10>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_9a3405ba9633e3de02e8045652521d39.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_9a3405ba9633e3de02e8045652521d39.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17315d990>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_f22e00e16c1a7d31fa5c078798b9e161.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_f22e00e16c1a7d31fa5c078798b9e161.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c48d0>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_061fd6f6c761fc4cb5c3e488880549f5.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_061fd6f6c761fc4cb5c3e488880549f5.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17317d4d0>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_d82ed33e98d640be86c5b5bb8e122410.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_d82ed33e98d640be86c5b5bb8e122410.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172113a50>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_b7ec83f6ff71d741bdd93cb55ad0e999.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b7ec83f6ff71d741bdd93cb55ad0e999.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725637d0>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_33b16da3a4e8aff11c2079773a0be970.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_33b16da3a4e8aff11c2079773a0be970.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172112490>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_4428900488db1682b3cd488b5dc584ae.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_4428900488db1682b3cd488b5dc584ae.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731632d0>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_814a3e5f5887cd31a845496a6ab62417.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_814a3e5f5887cd31a845496a6ab62417.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17941a010>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_daefb7192fa7a24b819eff4d9ad43ac5.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_daefb7192fa7a24b819eff4d9ad43ac5.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731dc1d0>
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fc6%252Fedc621d5a17d1137fca2cf14b5ce1ce6%252Fpa%252FSG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg saved to cache
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8542210c-f5ac-5415-b439-19ad7e59dfa0
2026-03-28 20:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8542210c-f5ac-5415-b439-19ad7e59dfa0, skipping ID generation
2026-03-28 20:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8542210c-f5ac-5415-b439-19ad7e59dfa0 with scrape type 1
2026-03-28 20:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8542210c-f5ac-5415-b439-19ad7e59dfa0 sending to next pipeline
2026-03-28 20:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8542210c-f5ac-5415-b439-19ad7e59dfa0, identifier: SG83875
2026-03-28 20:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875
2026-03-28 20:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875
2026-03-28 20:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875 to the API
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:42:51Z',
 'fuel_type': 'petrol',
 'id': '8542210c-f5ac-5415-b439-19ad7e59dfa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG83875',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 213416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_6ccfb30ac99e4f3ef9b99ddd45dd01a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_71144f8dfe92f0d958b8b2d0de24efe1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_06ffa2fb0b8ea23455dd41930ebbc186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_814a3e5f5887cd31a845496a6ab62417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_7486e85720efa357d5d00a1a11cfc89c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8542210c-f5ac-5415-b439-19ad7e59dfa0/8542210c-f5ac-5415-b439-19ad7e59dfa0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/c6/edc621d5a17d1137fca2cf14b5ce1ce6/pa/SG83875_85c6170dea282c27181394884fff8b85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2009}
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-28 20:32:44 [auto1.be] INFO: Saving data for SG83875: {'created_time': 1774729964.459902, 'last_price_update_time': 1774729964.459911, 'auction_closing_time': 1774885371.0}
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG83875') HTTP/1.1" 204 0
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720d6650>
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_e78c5fb43d7b088fa123441d82347876.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e78c5fb43d7b088fa123441d82347876.jpg saved to cache
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731fbe90>
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_10c5fec1b6526d4cf359563f6b9a809c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_10c5fec1b6526d4cf359563f6b9a809c.jpg saved to cache
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_98262f2912c1ddc03da663981cb8dbe6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_7df642b230ad2e2c29989f42a05733ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_7f12040a980876a5fed7f1f706246bfc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_9314852453d2596a20813878e6325860.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_5dc139bbd063534c0873e1d879146962.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_d0a67d877a24fe4af2a5a332d66477bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_fcb20dc8075d3c612a4addfbf1da2ec8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17256e690>
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Fa4%252F16a4ff459ebc77fcac0e34d5509266b9%252Fpa%252FBE30988_98262f2912c1ddc03da663981cb8dbe6.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_98262f2912c1ddc03da663981cb8dbe6.jpg saved to cache
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69dae1ce-8e8b-594b-a85c-20d168195f3e
2026-03-28 20:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69dae1ce-8e8b-594b-a85c-20d168195f3e, skipping ID generation
2026-03-28 20:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69dae1ce-8e8b-594b-a85c-20d168195f3e with scrape type 1
2026-03-28 20:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69dae1ce-8e8b-594b-a85c-20d168195f3e sending to next pipeline
2026-03-28 20:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69dae1ce-8e8b-594b-a85c-20d168195f3e, identifier: BE30988
2026-03-28 20:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988
2026-03-28 20:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988
2026-03-28 20:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988 to the API
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_98262f2912c1ddc03da663981cb8dbe6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:08:02Z',
 'fuel_type': 'diesel',
 'id': '69dae1ce-8e8b-594b-a85c-20d168195f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE30988',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 90108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_db0857e841472c9cb5b6d13d12a6c5da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 756924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_98262f2912c1ddc03da663981cb8dbe6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 699615,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_daefb7192fa7a24b819eff4d9ad43ac5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3446986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_f22e00e16c1a7d31fa5c078798b9e161.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 577964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_8a37e0efb70ea7bc36b070db162a147e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_402be44361a273660d0079a94d97185d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3382730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_9a3405ba9633e3de02e8045652521d39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_d9a7b940923e3f635674351064209dba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 854933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_1c6833628b010fdd439e775469879492.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69dae1ce-8e8b-594b-a85c-20d168195f3e/69dae1ce-8e8b-594b-a85c-20d168195f3e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/a4/16a4ff459ebc77fcac0e34d5509266b9/pa/BE30988_b605929f78548789e8f6bdcd4dbae1d8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2015}
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-28 20:32:45 [auto1.be] INFO: Saving data for BE30988: {'created_time': 1774729965.259905, 'last_price_update_time': 1774729965.259917, 'auction_closing_time': 1774883282.0}
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BE30988') HTTP/1.1" 204 0
2026-03-28 20:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_66bf23387578f8ed0bdc4ccb8b6916b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_93e2bd64244d7d2f7ad7ff001215932f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fa97d0>
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2d%252F532d3da8a1eb4d19e3922500f85f26de%252Fpa%252FUY14877_7df642b230ad2e2c29989f42a05733ad.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_7df642b230ad2e2c29989f42a05733ad.jpg saved to cache
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22
2026-03-28 20:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22, skipping ID generation
2026-03-28 20:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with scrape type 1
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 sending to next pipeline
2026-03-28 20:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22, identifier: UY14877
2026-03-28 20:32:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726f25d0>
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_7f12040a980876a5fed7f1f706246bfc.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_7f12040a980876a5fed7f1f706246bfc.jpg saved to cache
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17313fc10>
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Ff4%252F65f4845b7563fa0cbfc01e88eb2effb7%252Fpa%252FUM29446_9314852453d2596a20813878e6325860.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_9314852453d2596a20813878e6325860.jpg saved to cache
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf256247-d3d0-5776-8798-06a8b9b65eec
2026-03-28 20:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf256247-d3d0-5776-8798-06a8b9b65eec, skipping ID generation
2026-03-28 20:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf256247-d3d0-5776-8798-06a8b9b65eec with scrape type 1
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf256247-d3d0-5776-8798-06a8b9b65eec sending to next pipeline
2026-03-28 20:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf256247-d3d0-5776-8798-06a8b9b65eec, identifier: UM29446
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17263c390>
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_5dc139bbd063534c0873e1d879146962.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_5dc139bbd063534c0873e1d879146962.jpg saved to cache
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17215dc10>
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_d0a67d877a24fe4af2a5a332d66477bf.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_d0a67d877a24fe4af2a5a332d66477bf.jpg saved to cache
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17313d2d0>
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_fcb20dc8075d3c612a4addfbf1da2ec8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_fcb20dc8075d3c612a4addfbf1da2ec8.jpg saved to cache
2026-03-28 20:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877
2026-03-28 20:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 20:32:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877
2026-03-28 20:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877 to the API
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_7df642b230ad2e2c29989f42a05733ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:43:29Z',
 'fuel_type': 'petrol',
 'id': '5e79bfaa-db27-58a8-9d2c-1abfff02bc22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY14877',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 123525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_2953f03aba81a196d1e1fb8ef85d3542.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460233,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_897a07219b6570db5b5a1d2f36d35364.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 396930,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_4428900488db1682b3cd488b5dc584ae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2196673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_7df642b230ad2e2c29989f42a05733ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420133,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b91a152c4a96e69f61eaeaa75a13acac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e78c5fb43d7b088fa123441d82347876.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2176881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_b7ec83f6ff71d741bdd93cb55ad0e999.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_e94ba2b4333a81db7467bc3747055ba2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 422329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_98abf1547b66996dd4034540b0b4ee18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e79bfaa-db27-58a8-9d2c-1abfff02bc22/5e79bfaa-db27-58a8-9d2c-1abfff02bc22_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2d/532d3da8a1eb4d19e3922500f85f26de/pa/UY14877_33b16da3a4e8aff11c2079773a0be970.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2020}
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-28 20:32:46 [auto1.be] INFO: Saving data for UY14877: {'created_time': 1774729966.513555, 'last_price_update_time': 1774729966.513571, 'auction_closing_time': 1774885409.0}
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY14877') HTTP/1.1" 204 0
2026-03-28 20:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446
2026-03-28 20:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446
2026-03-28 20:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446 to the API
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_9314852453d2596a20813878e6325860.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:21Z',
 'fuel_type': 'diesel',
 'id': 'bf256247-d3d0-5776-8798-06a8b9b65eec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM29446',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 198454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_9314852453d2596a20813878e6325860.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_10c5fec1b6526d4cf359563f6b9a809c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_4ce05de2805371a1df26b1299d2a7e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_3fb957ffe1e5c3ab8538121e69354b29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_56973a253e32102b284832051d65c167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_a564b8bb947df4ef4321a9ed744878ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_061fd6f6c761fc4cb5c3e488880549f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_34abee9db68053d69d8722197d0d700e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_cd702887d8786f38d738aac9b865e681.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf256247-d3d0-5776-8798-06a8b9b65eec/bf256247-d3d0-5776-8798-06a8b9b65eec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/f4/65f4845b7563fa0cbfc01e88eb2effb7/pa/UM29446_d82ed33e98d640be86c5b5bb8e122410.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2013}
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-28 20:32:46 [auto1.be] INFO: Saving data for UM29446: {'created_time': 1774729966.897949, 'last_price_update_time': 1774729966.89796, 'auction_closing_time': 1774883961.0}
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM29446') HTTP/1.1" 204 0
2026-03-28 20:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_96f9c225ff0ef912d9490f294c7df687.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732e7610>
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_66bf23387578f8ed0bdc4ccb8b6916b1.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_66bf23387578f8ed0bdc4ccb8b6916b1.jpg saved to cache
2026-03-28 20:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b4e90>
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F80%252Fba803b9b5f472ec27fb0ff7dd3724989%252Fpa%252FKD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg saved to cache
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c958f8e7-3b3a-5bc5-a61a-08eebae96932
2026-03-28 20:32:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c958f8e7-3b3a-5bc5-a61a-08eebae96932, skipping ID generation
2026-03-28 20:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c958f8e7-3b3a-5bc5-a61a-08eebae96932 with scrape type 1
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c958f8e7-3b3a-5bc5-a61a-08eebae96932 sending to next pipeline
2026-03-28 20:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c958f8e7-3b3a-5bc5-a61a-08eebae96932, identifier: KD88013
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172132210>
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_93e2bd64244d7d2f7ad7ff001215932f.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_93e2bd64244d7d2f7ad7ff001215932f.jpg saved to cache
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013
2026-03-28 20:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013
2026-03-28 20:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013 to the API
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:50Z',
 'fuel_type': 'petrol',
 'id': 'c958f8e7-3b3a-5bc5-a61a-08eebae96932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD88013',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 231113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_23611c84d7346b2c6cd1d1cc973a04e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_fcb20dc8075d3c612a4addfbf1da2ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_d0a67d877a24fe4af2a5a332d66477bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_5dc139bbd063534c0873e1d879146962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_9bcc4ff5385a91b954819715add053da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c958f8e7-3b3a-5bc5-a61a-08eebae96932/c958f8e7-3b3a-5bc5-a61a-08eebae96932_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/80/ba803b9b5f472ec27fb0ff7dd3724989/pa/KD88013_e74a5cb1f768b68de8a748d7fae37398.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-28 20:32:47 [auto1.be] INFO: Saving data for KD88013: {'created_time': 1774729967.602582, 'last_price_update_time': 1774729967.602595, 'auction_closing_time': 1774885370.0}
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD88013') HTTP/1.1" 204 0
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17942ac90>
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_96f9c225ff0ef912d9490f294c7df687.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_96f9c225ff0ef912d9490f294c7df687.jpg saved to cache
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_d924f88daf7b747c6451067fb4cbb947.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_ff3283aaeb29c074daf2f710858fb4b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_978a8d57bb31c29906b16ad852777a95.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_bce31ce1156503aecc44e985b6beb56a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_624d7f97aaf13ce5b3a0894e7ca76a5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b378d1e3ba2c35d294484fec128be387.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173f5b950>
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_d924f88daf7b747c6451067fb4cbb947.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_d924f88daf7b747c6451067fb4cbb947.jpg saved to cache
2026-03-28 20:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_cd813ea9df39b0a388ffcf34faed6c96.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_2e8a5b4c337d7ac8a90d13258b59aefd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172146b90>
2026-03-28 20:32:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_ff3283aaeb29c074daf2f710858fb4b7.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_ff3283aaeb29c074daf2f710858fb4b7.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172156c50>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_978a8d57bb31c29906b16ad852777a95.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_978a8d57bb31c29906b16ad852777a95.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721a0f50>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_bce31ce1156503aecc44e985b6beb56a.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_bce31ce1156503aecc44e985b6beb56a.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726ea290>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_624d7f97aaf13ce5b3a0894e7ca76a5c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_624d7f97aaf13ce5b3a0894e7ca76a5c.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308ead0>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_b378d1e3ba2c35d294484fec128be387.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b378d1e3ba2c35d294484fec128be387.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172644410>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_cd813ea9df39b0a388ffcf34faed6c96.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_cd813ea9df39b0a388ffcf34faed6c96.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a4590>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_2e8a5b4c337d7ac8a90d13258b59aefd.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_2e8a5b4c337d7ac8a90d13258b59aefd.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ29736/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB30712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL22884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_8ee1514d63c74bf91500d797e08c1559.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN30582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725290d0>
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fbf%252F6ebff3a7420b8dd7cae7ba83960388b0%252Fpa%252FEM05161_8ee1514d63c74bf91500d797e08c1559.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_8ee1514d63c74bf91500d797e08c1559.jpg saved to cache
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c875d288-7127-58c9-8e16-0a9db6f2af22
2026-03-28 20:32:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c875d288-7127-58c9-8e16-0a9db6f2af22, skipping ID generation
2026-03-28 20:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c875d288-7127-58c9-8e16-0a9db6f2af22 with scrape type 1
2026-03-28 20:32:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c875d288-7127-58c9-8e16-0a9db6f2af22 sending to next pipeline
2026-03-28 20:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c875d288-7127-58c9-8e16-0a9db6f2af22, identifier: EM05161
2026-03-28 20:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161
2026-03-28 20:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161
2026-03-28 20:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161 to the API
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_8ee1514d63c74bf91500d797e08c1559.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'diesel',
 'id': 'c875d288-7127-58c9-8e16-0a9db6f2af22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM05161',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 191346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_8ee1514d63c74bf91500d797e08c1559.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_cd813ea9df39b0a388ffcf34faed6c96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_96f9c225ff0ef912d9490f294c7df687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_ff3283aaeb29c074daf2f710858fb4b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2341158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_d924f88daf7b747c6451067fb4cbb947.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_66bf23387578f8ed0bdc4ccb8b6916b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2411746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_7f12040a980876a5fed7f1f706246bfc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_e8d5044c7e2b69fddb8ce3da89cd1dc6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_a779d0cba861d260a814844395af3801.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c875d288-7127-58c9-8e16-0a9db6f2af22/c875d288-7127-58c9-8e16-0a9db6f2af22_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/bf/6ebff3a7420b8dd7cae7ba83960388b0/pa/EM05161_9114fa6f4f13b397f608d9baef75309d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Jetta 2.0 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2015}
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-28 20:32:49 [auto1.be] INFO: Saving data for EM05161: {'created_time': 1774729969.483417, 'last_price_update_time': 1774729969.483427, 'auction_closing_time': 1774883765.0}
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM05161') HTTP/1.1" 204 0
2026-03-28 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW89604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY92488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17329fe10>
2026-03-28 20:32:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd8%252F3cd8c3c8938a2f41d8d737047b647e86%252Fpa%252FMM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg saved to cache
2026-03-28 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e46d563-73d9-516a-8e04-7806d7e488c7
2026-03-28 20:32:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e46d563-73d9-516a-8e04-7806d7e488c7, skipping ID generation
2026-03-28 20:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e46d563-73d9-516a-8e04-7806d7e488c7 with scrape type 1
2026-03-28 20:32:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e46d563-73d9-516a-8e04-7806d7e488c7 sending to next pipeline
2026-03-28 20:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e46d563-73d9-516a-8e04-7806d7e488c7, identifier: MM51411
2026-03-28 20:32:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411
2026-03-28 20:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411
2026-03-28 20:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411 to the API
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:51Z',
 'fuel_type': 'diesel',
 'id': '4e46d563-73d9-516a-8e04-7806d7e488c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM51411',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 94131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b0585e90b8eff7f2e2aaba2a4d68c595.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_2e8a5b4c337d7ac8a90d13258b59aefd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_b378d1e3ba2c35d294484fec128be387.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2721299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_624d7f97aaf13ce5b3a0894e7ca76a5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582068,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_978a8d57bb31c29906b16ad852777a95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_93e2bd64244d7d2f7ad7ff001215932f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_bce31ce1156503aecc44e985b6beb56a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_80a9a7109acd91d629b4684ed02064b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_fc32afc209ef4f9c9db94cbe59d39871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e46d563-73d9-516a-8e04-7806d7e488c7/4e46d563-73d9-516a-8e04-7806d7e488c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d8/3cd8c3c8938a2f41d8d737047b647e86/pa/MM51411_d68e130779101442b6d4991cb6ca6b61.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 ed4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2016}
2026-03-28 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-28 20:32:50 [auto1.be] INFO: Saving data for MM51411: {'created_time': 1774729970.100608, 'last_price_update_time': 1774729970.100619, 'auction_closing_time': 1774884831.0}
2026-03-28 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MM51411') HTTP/1.1" 204 0
2026-03-28 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER91021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM88075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK30146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ75648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA37218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:51 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1094 | hits on page: 40
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-28 20:32:51 [auto1.be] INFO: Scrape type for ER36240: 1
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-28 20:32:51 [auto1.be] INFO: Scrape type for SD86163: 1
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-28 20:32:51 [auto1.be] INFO: Scrape type for BT92464: 1
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-28 20:32:51 [auto1.be] INFO: Scrape type for KG93945: 1
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-28 20:32:51 [auto1.be] INFO: Scrape type for HJ19751: 2
2026-03-28 20:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751
2026-03-28 20:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with scrape type 2
2026-03-28 20:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with scrape type 2
2026-03-28 20:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eb736e67-f928-5fa1-99d8-ec6f8fbbef12, identifier: HJ19751
2026-03-28 20:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751
2026-03-28 20:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751
2026-03-28 20:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751 to the API
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:08:34Z',
 'fuel_type': 'diesel',
 'id': 'eb736e67-f928-5fa1-99d8-ec6f8fbbef12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ19751',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 129357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2018}
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-28 20:32:51 [auto1.be] INFO: Saving data for HJ19751: {'auction_closing_time': 1774883314.0, 'created_time': 1774006254.730432, 'last_price_update_time': 1774729971.880523}
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ19751') HTTP/1.1" 204 0
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-28 20:32:51 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [auto1.be] INFO: Scrape type for JJ70860: 1
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [auto1.be] INFO: Scrape type for JR09444: 1
2026-03-28 20:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS82481> (referer: https://www.auto1.com/v1/car-details-view/PS82481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [auto1.be] INFO: Scrape type for ET82729: 2
2026-03-28 20:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729
2026-03-28 20:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with scrape type 2
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with scrape type 2
2026-03-28 20:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2, identifier: ET82729
2026-03-28 20:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729
2026-03-28 20:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729
2026-03-28 20:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729 to the API
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': '15492fe2-fbde-5093-8f7a-9cccd3b9e8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET82729',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 144520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-10-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 1997}
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [auto1.be] INFO: Saving data for ET82729: {'auction_closing_time': 1774883190.0, 'created_time': 1774038826.728784, 'last_price_update_time': 1774729972.485517}
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET82729') HTTP/1.1" 204 0
2026-03-28 20:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA12378> (referer: https://www.auto1.com/v1/car-details-view/ZA12378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [auto1.be] INFO: Scrape type for HL00392: 1
2026-03-28 20:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ54867> (referer: https://www.auto1.com/v1/car-details-view/FJ54867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT95399> (referer: https://www.auto1.com/v1/car-details-view/XT95399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [auto1.be] INFO: Scrape type for AU29077: 1
2026-03-28 20:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481
2026-03-28 20:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41278a24-fa97-598e-8039-834c90c278ad with scrape type 1
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41278a24-fa97-598e-8039-834c90c278ad
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_e6d042ee680558ef51825d8a72b15317.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_e6d042ee680558ef51825d8a72b15317.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_91777e4392cdcff76287fd14ee0e84fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_91777e4392cdcff76287fd14ee0e84fb.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_3f8b9b55089ae17a79b7f9ab268355ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_3f8b9b55089ae17a79b7f9ab268355ff.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_b1d42333299b06acc181c8863b30d4b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_b1d42333299b06acc181c8863b30d4b9.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_480e4349d49ef4f1f77535fb75b946cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_480e4349d49ef4f1f77535fb75b946cb.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_27a0b46042e1098d9d6c6a98353977f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_27a0b46042e1098d9d6c6a98353977f1.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_a09dfb900b840a32f45b686f10b93258.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_a09dfb900b840a32f45b686f10b93258.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_7527722955d45acc67a8515e6c94a178.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_7527722955d45acc67a8515e6c94a178.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_2b9994d13f196c9a3d588c3b5210dc79.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_2b9994d13f196c9a3d588c3b5210dc79.jpg already downloaded
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Fd9%252F2fd918a8982429a9069e85270eecebf9%252Fpa%252FPS82481_f3b91e705304facd9634bc901706bb99.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_f3b91e705304facd9634bc901706bb99.jpg already downloaded
2026-03-28 20:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41278a24-fa97-598e-8039-834c90c278ad, identifier: PS82481
2026-03-28 20:32:52 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [auto1.be] INFO: Scrape type for FL05782: 1
2026-03-28 20:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481
2026-03-28 20:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481
2026-03-28 20:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481 to the API
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS82481>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:59:31Z',
 'fuel_type': 'diesel',
 'id': '41278a24-fa97-598e-8039-834c90c278ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82481',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 101754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_e6d042ee680558ef51825d8a72b15317.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_91777e4392cdcff76287fd14ee0e84fb.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_3f8b9b55089ae17a79b7f9ab268355ff.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_b1d42333299b06acc181c8863b30d4b9.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_480e4349d49ef4f1f77535fb75b946cb.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_27a0b46042e1098d9d6c6a98353977f1.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_a09dfb900b840a32f45b686f10b93258.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_7527722955d45acc67a8515e6c94a178.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_2b9994d13f196c9a3d588c3b5210dc79.jpg',
                'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_f3b91e705304facd9634bc901706bb99.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 523911,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_e6d042ee680558ef51825d8a72b15317.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 496525,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_91777e4392cdcff76287fd14ee0e84fb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372444,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_3f8b9b55089ae17a79b7f9ab268355ff.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376094,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_b1d42333299b06acc181c8863b30d4b9.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387542,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_480e4349d49ef4f1f77535fb75b946cb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_27a0b46042e1098d9d6c6a98353977f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 436725,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_a09dfb900b840a32f45b686f10b93258.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517262,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_7527722955d45acc67a8515e6c94a178.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 500852,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_2b9994d13f196c9a3d588c3b5210dc79.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41278a24-fa97-598e-8039-834c90c278ad/41278a24-fa97-598e-8039-834c90c278ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401471,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/d9/2fd918a8982429a9069e85270eecebf9/pa/PS82481_f3b91e705304facd9634bc901706bb99.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [auto1.be] INFO: Saving data for PS82481: {'created_time': 1774729973.427234, 'last_price_update_time': 1774729973.427247, 'auction_closing_time': 1774886371.0}
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS82481') HTTP/1.1" 204 0
2026-03-28 20:32:53 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-28 20:32:53 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-28 20:32:53 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [auto1.be] INFO: Scrape type for UY27001: 1
2026-03-28 20:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL22884> (referer: https://www.auto1.com/v1/car-details-view/RL22884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378
2026-03-28 20:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with scrape type 1
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_1c26d946146ca65007bf7dbb8d48d2e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_1c26d946146ca65007bf7dbb8d48d2e6.jpg not downloaded yet
2026-03-28 20:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867
2026-03-28 20:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with scrape type 1
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e54d7cb2-a45d-586c-b50d-b1bb0e237b1e
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_4a809fbe1af9d4807b6966f15b00bcdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_4a809fbe1af9d4807b6966f15b00bcdf.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_3f54d2472af40f6cc28b7110fe23be65.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_3f54d2472af40f6cc28b7110fe23be65.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_1f10d8d01c2215d44736feed240bdf56.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_1f10d8d01c2215d44736feed240bdf56.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_dcadcbd940bb1000148c7a1f787e3686.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_dcadcbd940bb1000148c7a1f787e3686.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_00fc47193fddf90d7a10c9a17640914b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_00fc47193fddf90d7a10c9a17640914b.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_0d81c5c62b46e27f0b1ea5e5471bd64a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_0d81c5c62b46e27f0b1ea5e5471bd64a.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_fb87aa496d2841ded5a5816ea60308af.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_fb87aa496d2841ded5a5816ea60308af.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_fcaee8b34be7b01ccd95d55d8db8c112.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_fcaee8b34be7b01ccd95d55d8db8c112.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_487f85d5f31b141989ce668fed6873f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_487f85d5f31b141989ce668fed6873f5.jpg already downloaded
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F66%252F0c66c88bb43fd44be76e1eee19954fb1%252Fpa%252FFJ54867_027ebe69bbd32fc13d5503cfdbc38ad4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_027ebe69bbd32fc13d5503cfdbc38ad4.jpg already downloaded
2026-03-28 20:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e, identifier: FJ54867
2026-03-28 20:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399
2026-03-28 20:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12fc53b-c065-5571-8c64-bac63f333f11 with scrape type 1
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_6479dd96a48ed0a3c07f3e1c4e3f43b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6479dd96a48ed0a3c07f3e1c4e3f43b0.jpg not downloaded yet
2026-03-28 20:32:53 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-28 20:32:53 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-28 20:32:53 [auto1.be] INFO: Scrape type for CM21252: 1
2026-03-28 20:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867
2026-03-28 20:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867
2026-03-28 20:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867 to the API
2026-03-28 20:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ54867>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:53:12Z',
 'fuel_type': 'petrol',
 'id': 'e54d7cb2-a45d-586c-b50d-b1bb0e237b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ54867',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 53396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_4a809fbe1af9d4807b6966f15b00bcdf.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_3f54d2472af40f6cc28b7110fe23be65.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_1f10d8d01c2215d44736feed240bdf56.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_dcadcbd940bb1000148c7a1f787e3686.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_00fc47193fddf90d7a10c9a17640914b.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_0d81c5c62b46e27f0b1ea5e5471bd64a.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_fb87aa496d2841ded5a5816ea60308af.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_fcaee8b34be7b01ccd95d55d8db8c112.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_487f85d5f31b141989ce668fed6873f5.jpg',
                'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_027ebe69bbd32fc13d5503cfdbc38ad4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_4a809fbe1af9d4807b6966f15b00bcdf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553525,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_3f54d2472af40f6cc28b7110fe23be65.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_1f10d8d01c2215d44736feed240bdf56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491389,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_dcadcbd940bb1000148c7a1f787e3686.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_00fc47193fddf90d7a10c9a17640914b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_0d81c5c62b46e27f0b1ea5e5471bd64a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_fb87aa496d2841ded5a5816ea60308af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_fcaee8b34be7b01ccd95d55d8db8c112.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469233,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_487f85d5f31b141989ce668fed6873f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e54d7cb2-a45d-586c-b50d-b1bb0e237b1e/e54d7cb2-a45d-586c-b50d-b1bb0e237b1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/66/0c66c88bb43fd44be76e1eee19954fb1/pa/FJ54867_027ebe69bbd32fc13d5503cfdbc38ad4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2017}
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [auto1.be] INFO: Saving data for FJ54867: {'created_time': 1774729974.158719, 'last_price_update_time': 1774729974.158731, 'auction_closing_time': 1774885992.0}
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ54867') HTTP/1.1" 204 0
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_52c937d049834acf5a60b0b7481401d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_52c937d049834acf5a60b0b7481401d6.jpg not downloaded yet
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_6dcff50ae1cc16357bea45d078e5e3b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6dcff50ae1cc16357bea45d078e5e3b3.jpg not downloaded yet
2026-03-28 20:32:54 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [auto1.be] INFO: Scrape type for SU85893: 1
2026-03-28 20:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB30712> (referer: https://www.auto1.com/v1/car-details-view/JB30712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884
2026-03-28 20:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e2fab90-4194-567b-8cab-62e6e9403f2b with scrape type 1
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e2fab90-4194-567b-8cab-62e6e9403f2b
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_2966700c0fd86b0fff716977df00dca9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_2966700c0fd86b0fff716977df00dca9.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_f358a6b7018cc82349da7502e43b0708.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_f358a6b7018cc82349da7502e43b0708.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_61628b2dc62fec4266fbdadf94e3a66d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_61628b2dc62fec4266fbdadf94e3a66d.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_64610db4b410d11e2f51fd9914d07423.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_64610db4b410d11e2f51fd9914d07423.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_bf3132e4df04142b7c441699c5fdaf99.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_bf3132e4df04142b7c441699c5fdaf99.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_6a88674cb1b26e1f1b555a1bfb5e2ec5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_6a88674cb1b26e1f1b555a1bfb5e2ec5.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_01080af53930bc852f39c93eac2b74fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_01080af53930bc852f39c93eac2b74fa.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_2b615c0f4920fb65053221a4f404f9ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_2b615c0f4920fb65053221a4f404f9ad.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_d8cee83673f4d9fe3a1cd3c35796d8b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_d8cee83673f4d9fe3a1cd3c35796d8b8.jpg already downloaded
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb8336284d0edb6c9a4a490d368970e06%252Fpa%252FRL22884_7f1e23c8e06f60f875a46075d998db1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_7f1e23c8e06f60f875a46075d998db1b.jpg already downloaded
2026-03-28 20:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9e2fab90-4194-567b-8cab-62e6e9403f2b, identifier: RL22884
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_81d9a314c3ae7b5abbe8b6881b3a309c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_81d9a314c3ae7b5abbe8b6881b3a309c.jpg not downloaded yet
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_98a8e11b837d2ef02f289a522e659379.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_98a8e11b837d2ef02f289a522e659379.jpg not downloaded yet
2026-03-28 20:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884
2026-03-28 20:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884
2026-03-28 20:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884 to the API
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL22884>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'petrol',
 'id': '9e2fab90-4194-567b-8cab-62e6e9403f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL22884',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 93212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_2966700c0fd86b0fff716977df00dca9.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_f358a6b7018cc82349da7502e43b0708.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_61628b2dc62fec4266fbdadf94e3a66d.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_64610db4b410d11e2f51fd9914d07423.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_bf3132e4df04142b7c441699c5fdaf99.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_6a88674cb1b26e1f1b555a1bfb5e2ec5.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_01080af53930bc852f39c93eac2b74fa.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_2b615c0f4920fb65053221a4f404f9ad.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_d8cee83673f4d9fe3a1cd3c35796d8b8.jpg',
                'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_7f1e23c8e06f60f875a46075d998db1b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_2966700c0fd86b0fff716977df00dca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_f358a6b7018cc82349da7502e43b0708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_61628b2dc62fec4266fbdadf94e3a66d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_64610db4b410d11e2f51fd9914d07423.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_bf3132e4df04142b7c441699c5fdaf99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_6a88674cb1b26e1f1b555a1bfb5e2ec5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_01080af53930bc852f39c93eac2b74fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_2b615c0f4920fb65053221a4f404f9ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_d8cee83673f4d9fe3a1cd3c35796d8b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e2fab90-4194-567b-8cab-62e6e9403f2b/9e2fab90-4194-567b-8cab-62e6e9403f2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b8336284d0edb6c9a4a490d368970e06/pa/RL22884_7f1e23c8e06f60f875a46075d998db1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-28 20:32:54 [auto1.be] INFO: Saving data for RL22884: {'created_time': 1774729974.985118, 'last_price_update_time': 1774729974.985134, 'auction_closing_time': 1774885534.0}
2026-03-28 20:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL22884') HTTP/1.1" 204 0
2026-03-28 20:32:55 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [auto1.be] INFO: Scrape type for DT20121: 1
2026-03-28 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ29736> (referer: https://www.auto1.com/v1/car-details-view/DZ29736/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_010018354afb1eb5ad11614f39530c6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_010018354afb1eb5ad11614f39530c6e.jpg not downloaded yet
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg not downloaded yet
2026-03-28 20:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY92488> (referer: https://www.auto1.com/v1/car-details-view/AY92488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ39903> (referer: https://www.auto1.com/v1/car-details-view/AZ39903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:55 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [auto1.be] INFO: Scrape type for VM76060: 1
2026-03-28 20:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712
2026-03-28 20:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0957ddb1-4635-5fc3-b0b3-38d43f946675 with scrape type 1
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_96cc0404638274781a6f9eb12703aea2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_96cc0404638274781a6f9eb12703aea2.jpg not downloaded yet
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_e30ed2b95ce1727a4ea352168ba31fe1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_e30ed2b95ce1727a4ea352168ba31fe1.jpg not downloaded yet
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_6f6c86d911d921741c1c76c7db76ef5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6f6c86d911d921741c1c76c7db76ef5e.jpg not downloaded yet
2026-03-28 20:32:55 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_f61e9d6f2a90895363243f3efce78002.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_f61e9d6f2a90895363243f3efce78002.jpg not downloaded yet
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_d749660f9d837265a7df1624d461a89c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_d749660f9d837265a7df1624d461a89c.jpg not downloaded yet
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_1c6a5fafe9373bd37d4100ba94f75e87.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_1c6a5fafe9373bd37d4100ba94f75e87.jpg not downloaded yet
2026-03-28 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER91021> (referer: https://www.auto1.com/v1/car-details-view/ER91021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH35268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_a60c2634c79e652a9c0492a459d6ef61.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_a60c2634c79e652a9c0492a459d6ef61.jpg not downloaded yet
2026-03-28 20:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_696ca61cfd0623dcfe9968965330b1f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_696ca61cfd0623dcfe9968965330b1f8.jpg not downloaded yet
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_8c03db3329da6f0b561d43037d7fac47.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_8c03db3329da6f0b561d43037d7fac47.jpg not downloaded yet
2026-03-28 20:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736
2026-03-28 20:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293849fa-2ab7-506d-935d-9c24abc49862 with scrape type 1
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg not downloaded yet
2026-03-28 20:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488
2026-03-28 20:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2b7495-0d90-542a-8905-9bebf4522d2d with scrape type 1
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_16e05547232b6cfc0854f0162d5f840e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_16e05547232b6cfc0854f0162d5f840e.jpg not downloaded yet
2026-03-28 20:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903
2026-03-28 20:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04a1c9a-af11-5303-808e-64c423bd9d9d with scrape type 1
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b04a1c9a-af11-5303-808e-64c423bd9d9d
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_6993e948e03241e7fa557d77c49ce364.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_6993e948e03241e7fa557d77c49ce364.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_fd614defc999fd6fc5df2a2719fb2ea5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_fd614defc999fd6fc5df2a2719fb2ea5.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_77f0dd4056486c949c867580a0e29d4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_77f0dd4056486c949c867580a0e29d4c.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_b719f1cdc20b95f1870cf67c993ca35d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b719f1cdc20b95f1870cf67c993ca35d.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_b2841cda214d1cda66ab3dc72cf658ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b2841cda214d1cda66ab3dc72cf658ee.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_622698693886cf8bc42da65066d3e924.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_622698693886cf8bc42da65066d3e924.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_1302bcfdb771a4ff40061945cbbef190.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_1302bcfdb771a4ff40061945cbbef190.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_2dd711a35d34968bfc19cd835f9d8aaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_2dd711a35d34968bfc19cd835f9d8aaf.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_b5a51433bb656d4aec5485defdf6e96b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b5a51433bb656d4aec5485defdf6e96b.jpg already downloaded
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F21%252F77213e3d26a0525dbf7fb766e1e60300%252Fpa%252FAZ39903_e3bd0d59d2029c555a4eb8bfd86e83f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_e3bd0d59d2029c555a4eb8bfd86e83f9.jpg already downloaded
2026-03-28 20:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b04a1c9a-af11-5303-808e-64c423bd9d9d, identifier: AZ39903
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_75a54ac8d32ac65dfaa64d86659b8793.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_75a54ac8d32ac65dfaa64d86659b8793.jpg not downloaded yet
2026-03-28 20:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903
2026-03-28 20:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903
2026-03-28 20:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903 to the API
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AZ39903>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:02Z',
 'fuel_type': 'diesel',
 'id': 'b04a1c9a-af11-5303-808e-64c423bd9d9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ39903',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 183821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_6993e948e03241e7fa557d77c49ce364.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_fd614defc999fd6fc5df2a2719fb2ea5.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_77f0dd4056486c949c867580a0e29d4c.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b719f1cdc20b95f1870cf67c993ca35d.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b2841cda214d1cda66ab3dc72cf658ee.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_622698693886cf8bc42da65066d3e924.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_1302bcfdb771a4ff40061945cbbef190.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_2dd711a35d34968bfc19cd835f9d8aaf.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b5a51433bb656d4aec5485defdf6e96b.jpg',
                'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_e3bd0d59d2029c555a4eb8bfd86e83f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_6993e948e03241e7fa557d77c49ce364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_fd614defc999fd6fc5df2a2719fb2ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_77f0dd4056486c949c867580a0e29d4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b719f1cdc20b95f1870cf67c993ca35d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b2841cda214d1cda66ab3dc72cf658ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_622698693886cf8bc42da65066d3e924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_1302bcfdb771a4ff40061945cbbef190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_2dd711a35d34968bfc19cd835f9d8aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_b5a51433bb656d4aec5485defdf6e96b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b04a1c9a-af11-5303-808e-64c423bd9d9d/b04a1c9a-af11-5303-808e-64c423bd9d9d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/21/77213e3d26a0525dbf7fb766e1e60300/pa/AZ39903_e3bd0d59d2029c555a4eb8bfd86e83f9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [auto1.be] INFO: Saving data for AZ39903: {'created_time': 1774729976.07205, 'last_price_update_time': 1774729976.072062, 'auction_closing_time': 1774883042.0}
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AZ39903') HTTP/1.1" 204 0
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_7b4e84863152a193f140bf828c88450c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_7b4e84863152a193f140bf828c88450c.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_64597a16012e44267beb3a873462ebf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_64597a16012e44267beb3a873462ebf0.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_508be3a1034696d15ad16ee978c7e42c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_508be3a1034696d15ad16ee978c7e42c.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_64b8c7ebbc3d29caea67d31cf4c8ceb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_64b8c7ebbc3d29caea67d31cf4c8ceb6.jpg not downloaded yet
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_98a8e11b837d2ef02f289a522e659379.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_84084621db628ff1468d7791e3dc1aff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_84084621db628ff1468d7791e3dc1aff.jpg not downloaded yet
2026-03-28 20:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021
2026-03-28 20:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f139f460-7c0e-5587-909d-b55d1a4b326e with scrape type 1
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_1b9018a9d80350abd479275a5d3790fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1b9018a9d80350abd479275a5d3790fe.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_2c7f5d0aca2510593d12a822a0c78d78.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_2c7f5d0aca2510593d12a822a0c78d78.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_115661da6bea14118121aac615165f6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_115661da6bea14118121aac615165f6c.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_9bdc89c4fdc45e3d6f24b35f5fbe9a28.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_9bdc89c4fdc45e3d6f24b35f5fbe9a28.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_e93c8957c8b496ea334daac0beb6e405.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_e93c8957c8b496ea334daac0beb6e405.jpg not downloaded yet
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM88075> (referer: https://www.auto1.com/v1/car-details-view/EM88075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_3273f1571a42dde997b27db82cb118f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_3273f1571a42dde997b27db82cb118f4.jpg not downloaded yet
2026-03-28 20:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_318c9942e336d759135f9e9801f9e5ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_318c9942e336d759135f9e9801f9e5ac.jpg not downloaded yet
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_81d9a314c3ae7b5abbe8b6881b3a309c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_80c2f21d071de90c136dbac6c055057f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_80c2f21d071de90c136dbac6c055057f.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_c3253a77ebf8f81806bbf417c8523fd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_c3253a77ebf8f81806bbf417c8523fd3.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_1d2c9697fddc31eae4b44882e3b8cdb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_1d2c9697fddc31eae4b44882e3b8cdb1.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_95f0846a4ab65d21134a57d1d541691b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_95f0846a4ab65d21134a57d1d541691b.jpg not downloaded yet
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW89604> (referer: https://www.auto1.com/v1/car-details-view/DW89604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_af6fd17a503bc2c427ad823fa35bcd48.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_af6fd17a503bc2c427ad823fa35bcd48.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_b972a7ba32a0f86ea6e659dcfe21a1c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_b972a7ba32a0f86ea6e659dcfe21a1c0.jpg not downloaded yet
2026-03-28 20:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730f7d10>
2026-03-28 20:32:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_98a8e11b837d2ef02f289a522e659379.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_98a8e11b837d2ef02f289a522e659379.jpg saved to cache
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_1c6a5fafe9373bd37d4100ba94f75e87.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_18d7a1c31a7be737009d148701421d30.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18d7a1c31a7be737009d148701421d30.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_4834bfd7a0dde1b9c4caf1f4061fe89d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4834bfd7a0dde1b9c4caf1f4061fe89d.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_57362b76a50706564f64f05b309526d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_57362b76a50706564f64f05b309526d6.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_daa652d7743cbacc20a962b91ad262d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_daa652d7743cbacc20a962b91ad262d0.jpg not downloaded yet
2026-03-28 20:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075
2026-03-28 20:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with scrape type 1
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ebacc93e-63fe-5bb6-a00d-c7af44fbed3e
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F59%252F8d590d555ce9004765f712eb9d4988b0%252Fpa%252FEM88075_0c31b8afad801897cee3e1f424e1628e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_0c31b8afad801897cee3e1f424e1628e.jpg already downloaded
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F59%252F8d590d555ce9004765f712eb9d4988b0%252Fpa%252FEM88075_ea8dd5b4d1b46018892187e82df97cd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_ea8dd5b4d1b46018892187e82df97cd3.jpg already downloaded
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F59%252F8d590d555ce9004765f712eb9d4988b0%252Fpa%252FEM88075_e97c5b0b3302c7fcad6aa3c0fe45ce2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_e97c5b0b3302c7fcad6aa3c0fe45ce2b.jpg already downloaded
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F59%252F8d590d555ce9004765f712eb9d4988b0%252Fpa%252FEM88075_8dc4673d9591db0dd8e4da1ccf72a68d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_8dc4673d9591db0dd8e4da1ccf72a68d.jpg already downloaded
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F59%252F8d590d555ce9004765f712eb9d4988b0%252Fpa%252FEM88075_0f5828294dc065f24b73f7388cc00a88.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_0f5828294dc065f24b73f7388cc00a88.jpg already downloaded
2026-03-28 20:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e, identifier: EM88075
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_d749660f9d837265a7df1624d461a89c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_75a54ac8d32ac65dfaa64d86659b8793.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_cdff795ffe6105a0b670b9b4b5ed862a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_cdff795ffe6105a0b670b9b4b5ed862a.jpg not downloaded yet
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_a2cd5f0aec7dbc55587b42a6f35d072c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a2cd5f0aec7dbc55587b42a6f35d072c.jpg not downloaded yet
2026-03-28 20:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075
2026-03-28 20:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075
2026-03-28 20:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075 to the API
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM88075>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:43:58Z',
 'fuel_type': 'diesel',
 'id': 'ebacc93e-63fe-5bb6-a00d-c7af44fbed3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM88075',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 212145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_0c31b8afad801897cee3e1f424e1628e.jpg',
                'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_ea8dd5b4d1b46018892187e82df97cd3.jpg',
                'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_e97c5b0b3302c7fcad6aa3c0fe45ce2b.jpg',
                'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_8dc4673d9591db0dd8e4da1ccf72a68d.jpg',
                'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_0f5828294dc065f24b73f7388cc00a88.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebacc93e-63fe-5bb6-a00d-c7af44fbed3e/ebacc93e-63fe-5bb6-a00d-c7af44fbed3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_0c31b8afad801897cee3e1f424e1628e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebacc93e-63fe-5bb6-a00d-c7af44fbed3e/ebacc93e-63fe-5bb6-a00d-c7af44fbed3e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_ea8dd5b4d1b46018892187e82df97cd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebacc93e-63fe-5bb6-a00d-c7af44fbed3e/ebacc93e-63fe-5bb6-a00d-c7af44fbed3e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_e97c5b0b3302c7fcad6aa3c0fe45ce2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebacc93e-63fe-5bb6-a00d-c7af44fbed3e/ebacc93e-63fe-5bb6-a00d-c7af44fbed3e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_8dc4673d9591db0dd8e4da1ccf72a68d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebacc93e-63fe-5bb6-a00d-c7af44fbed3e/ebacc93e-63fe-5bb6-a00d-c7af44fbed3e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/59/8d590d555ce9004765f712eb9d4988b0/pa/EM88075_0f5828294dc065f24b73f7388cc00a88.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2009}
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [auto1.be] INFO: Saving data for EM88075: {'created_time': 1774729977.303312, 'last_price_update_time': 1774729977.303324, 'auction_closing_time': 1774885438.0}
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM88075') HTTP/1.1" 204 0
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1796098d0>
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_81d9a314c3ae7b5abbe8b6881b3a309c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_81d9a314c3ae7b5abbe8b6881b3a309c.jpg saved to cache
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604
2026-03-28 20:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b595d89-6e5d-5199-85ea-67227817cfc8 with scrape type 1
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_556893e1b6730598046653788958cfa1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_556893e1b6730598046653788958cfa1.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_c5f92325c64faa42c29bd680ffebe7bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_c5f92325c64faa42c29bd680ffebe7bb.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_bd86e20331c507c8a05fa7db43f2db70.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_bd86e20331c507c8a05fa7db43f2db70.jpg not downloaded yet
2026-03-28 20:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_318c9942e336d759135f9e9801f9e5ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_3d908afef8fd532d7a47dad18faa910c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_3d908afef8fd532d7a47dad18faa910c.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_4fe7e81fc0918086040975512abd805d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4fe7e81fc0918086040975512abd805d.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_8893f6a1165da49fd87e4f74fa614439.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_8893f6a1165da49fd87e4f74fa614439.jpg not downloaded yet
2026-03-28 20:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR09444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ75648> (referer: https://www.auto1.com/v1/car-details-view/NZ75648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_0a6970059f01c5c55bc5c3fcc9bb3e9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_0a6970059f01c5c55bc5c3fcc9bb3e9f.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_5f1f15031709bb971531c120f1f37437.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_5f1f15031709bb971531c120f1f37437.jpg not downloaded yet
2026-03-28 20:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK30146> (referer: https://www.auto1.com/v1/car-details-view/LK30146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730157d0>
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_1c6a5fafe9373bd37d4100ba94f75e87.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_1c6a5fafe9373bd37d4100ba94f75e87.jpg saved to cache
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:32:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790df210>
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_d749660f9d837265a7df1624d461a89c.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_d749660f9d837265a7df1624d461a89c.jpg saved to cache
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fc8e90>
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_75a54ac8d32ac65dfaa64d86659b8793.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_75a54ac8d32ac65dfaa64d86659b8793.jpg saved to cache
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_18205b88c9122f471e3354e4d558ec62.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18205b88c9122f471e3354e4d558ec62.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_a28edd39d3743cd55d277300aa681029.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a28edd39d3743cd55d277300aa681029.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_4e993aa271f34fb3398e516621e03293.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_4e993aa271f34fb3398e516621e03293.jpg not downloaded yet
2026-03-28 20:32:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_f26288d4ea4aaef7c7778f01d07dfa23.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_f26288d4ea4aaef7c7778f01d07dfa23.jpg not downloaded yet
2026-03-28 20:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL00392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_8008a04f2a15e4b4fe17d8d62871ef06.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_8008a04f2a15e4b4fe17d8d62871ef06.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_b0ccc6a97863b977b0fe9663b9f8ad50.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_b0ccc6a97863b977b0fe9663b9f8ad50.jpg not downloaded yet
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_319eea8d32e4cc9051451f699495d24a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_319eea8d32e4cc9051451f699495d24a.jpg not downloaded yet
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:32:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172672690>
2026-03-28 20:32:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:32:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_318c9942e336d759135f9e9801f9e5ac.jpg') HTTP/1.1" 204 0
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_318c9942e336d759135f9e9801f9e5ac.jpg saved to cache
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648
2026-03-28 20:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5094a600-a4f5-549d-b3b6-6a01d4eddcec with scrape type 1
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5094a600-a4f5-549d-b3b6-6a01d4eddcec
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_4bd234088b8dc69b6582829bee501dd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_4bd234088b8dc69b6582829bee501dd4.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_fdd968670d17411275ddd54feb102311.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_fdd968670d17411275ddd54feb102311.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_b753d2bd9ae82c49920bf87e3beb7da0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_b753d2bd9ae82c49920bf87e3beb7da0.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_5f027e0573fc2381ce2fd24da806d3d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_5f027e0573fc2381ce2fd24da806d3d5.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_c618d81ed3b78e87caff2d51d7e4d345.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_c618d81ed3b78e87caff2d51d7e4d345.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_8cc3c0871eabbfbd9bf7d637788dfd8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_8cc3c0871eabbfbd9bf7d637788dfd8d.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_78ecdccc652fd1315c4ad8f27acf1531.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_78ecdccc652fd1315c4ad8f27acf1531.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_1f239fef36098275f9e2bffaed021586.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_1f239fef36098275f9e2bffaed021586.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_6959f55831531bda7005de3974f30f66.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_6959f55831531bda7005de3974f30f66.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F65%252F5865596f9a687ddf7eac0b63b93195f2%252Fpa%252FNZ75648_c8c2762b06b77a6e7e8f2237de713c5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_c8c2762b06b77a6e7e8f2237de713c5f.jpg already downloaded
2026-03-28 20:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5094a600-a4f5-549d-b3b6-6a01d4eddcec, identifier: NZ75648
2026-03-28 20:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146
2026-03-28 20:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58dff96-1158-5453-986d-328659d0c2af with scrape type 1
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d58dff96-1158-5453-986d-328659d0c2af
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_972c790cafc9f2f7f688031faedb521a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_972c790cafc9f2f7f688031faedb521a.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_2747e024b8e77ae41445c7f8960fb914.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_2747e024b8e77ae41445c7f8960fb914.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_32eeeaaa48284eef7aa254769972bea2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_32eeeaaa48284eef7aa254769972bea2.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_c522163db996ac6bc2047fdbd17c9fe2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_c522163db996ac6bc2047fdbd17c9fe2.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_45956cb5b45f96eafae6e135990ec926.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_45956cb5b45f96eafae6e135990ec926.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_11b928f11dc2145f3a62b6f7cd8939f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_11b928f11dc2145f3a62b6f7cd8939f9.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_8a444e3df63050fc3e73cd7ad16dd198.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_8a444e3df63050fc3e73cd7ad16dd198.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_e36a7059a06913287fb1cc26054c3c5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_e36a7059a06913287fb1cc26054c3c5f.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_1c505ecb81e308233ed65e75264df17b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_1c505ecb81e308233ed65e75264df17b.jpg already downloaded
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F48%252F5d489ad46fee514b20f671ceb04207af%252Fpa%252FLK30146_2914ee16596743c2e10bcb43ea61a9e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_2914ee16596743c2e10bcb43ea61a9e0.jpg already downloaded
2026-03-28 20:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d58dff96-1158-5453-986d-328659d0c2af, identifier: LK30146
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_1bb386da4b7ea74e35e1bdd10ef647d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1bb386da4b7ea74e35e1bdd10ef647d3.jpg not downloaded yet
2026-03-28 20:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648
2026-03-28 20:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648
2026-03-28 20:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648 to the API
2026-03-28 20:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ75648>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:38:11Z',
 'fuel_type': 'diesel',
 'id': '5094a600-a4f5-549d-b3b6-6a01d4eddcec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ75648',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 206189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_4bd234088b8dc69b6582829bee501dd4.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_fdd968670d17411275ddd54feb102311.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_b753d2bd9ae82c49920bf87e3beb7da0.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_5f027e0573fc2381ce2fd24da806d3d5.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_c618d81ed3b78e87caff2d51d7e4d345.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_8cc3c0871eabbfbd9bf7d637788dfd8d.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_78ecdccc652fd1315c4ad8f27acf1531.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_1f239fef36098275f9e2bffaed021586.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_6959f55831531bda7005de3974f30f66.jpg',
                'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_c8c2762b06b77a6e7e8f2237de713c5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2402770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_4bd234088b8dc69b6582829bee501dd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553545,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_fdd968670d17411275ddd54feb102311.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_b753d2bd9ae82c49920bf87e3beb7da0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_5f027e0573fc2381ce2fd24da806d3d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_c618d81ed3b78e87caff2d51d7e4d345.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2381082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_8cc3c0871eabbfbd9bf7d637788dfd8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_78ecdccc652fd1315c4ad8f27acf1531.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_1f239fef36098275f9e2bffaed021586.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_6959f55831531bda7005de3974f30f66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5094a600-a4f5-549d-b3b6-6a01d4eddcec/5094a600-a4f5-549d-b3b6-6a01d4eddcec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2233814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/65/5865596f9a687ddf7eac0b63b93195f2/pa/NZ75648_c8c2762b06b77a6e7e8f2237de713c5f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Freelander 2.2 Td4 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2014}
2026-03-28 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-28 20:32:59 [auto1.be] INFO: Saving data for NZ75648: {'created_time': 1774729979.904286, 'last_price_update_time': 1774729979.904299, 'auction_closing_time': 1774885091.0}
2026-03-28 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ75648') HTTP/1.1" 204 0
2026-03-28 20:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146
2026-03-28 20:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146
2026-03-28 20:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146 to the API
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LK30146>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:26:24Z',
 'fuel_type': 'petrol',
 'id': 'd58dff96-1158-5453-986d-328659d0c2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK30146',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 112585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_972c790cafc9f2f7f688031faedb521a.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_2747e024b8e77ae41445c7f8960fb914.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_32eeeaaa48284eef7aa254769972bea2.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_c522163db996ac6bc2047fdbd17c9fe2.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_45956cb5b45f96eafae6e135990ec926.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_11b928f11dc2145f3a62b6f7cd8939f9.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_8a444e3df63050fc3e73cd7ad16dd198.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_e36a7059a06913287fb1cc26054c3c5f.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_1c505ecb81e308233ed65e75264df17b.jpg',
                'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_2914ee16596743c2e10bcb43ea61a9e0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_972c790cafc9f2f7f688031faedb521a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_2747e024b8e77ae41445c7f8960fb914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_32eeeaaa48284eef7aa254769972bea2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_c522163db996ac6bc2047fdbd17c9fe2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_45956cb5b45f96eafae6e135990ec926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_11b928f11dc2145f3a62b6f7cd8939f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_8a444e3df63050fc3e73cd7ad16dd198.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_e36a7059a06913287fb1cc26054c3c5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_1c505ecb81e308233ed65e75264df17b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d58dff96-1158-5453-986d-328659d0c2af/d58dff96-1158-5453-986d-328659d0c2af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/48/5d489ad46fee514b20f671ceb04207af/pa/LK30146_2914ee16596743c2e10bcb43ea61a9e0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [auto1.be] INFO: Saving data for LK30146: {'created_time': 1774729980.255402, 'last_price_update_time': 1774729980.255412, 'auction_closing_time': 1774884384.0}
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK30146') HTTP/1.1" 204 0
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_556893e1b6730598046653788958cfa1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_facd236f123e819fa55ca3b7dc0e9746.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_facd236f123e819fa55ca3b7dc0e9746.jpg not downloaded yet
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_4bd92831731b9e5884b2bb747d0d4736.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4bd92831731b9e5884b2bb747d0d4736.jpg not downloaded yet
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_c6c35bdac715193011181f8cc09ed4ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_c6c35bdac715193011181f8cc09ed4ab.jpg not downloaded yet
2026-03-28 20:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_8893f6a1165da49fd87e4f74fa614439.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_60d9ab6e217770bf4cb55a3e492ae169.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_60d9ab6e217770bf4cb55a3e492ae169.jpg not downloaded yet
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL05782/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA37218> (referer: https://www.auto1.com/v1/car-details-view/UA37218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_ae6c73e12dbe5237059f9138135b76f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_ae6c73e12dbe5237059f9138135b76f0.jpg not downloaded yet
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_bd86e20331c507c8a05fa7db43f2db70.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_a3af7ea526d4af49f5042dfa0b4116af.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_a3af7ea526d4af49f5042dfa0b4116af.jpg not downloaded yet
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_e14ec09e9af8e58590b9db120c83d567.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_e14ec09e9af8e58590b9db120c83d567.jpg not downloaded yet
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17251d6d0>
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_556893e1b6730598046653788958cfa1.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_556893e1b6730598046653788958cfa1.jpg saved to cache
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_994949c3ffd8faefad079ecd6c114000.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_994949c3ffd8faefad079ecd6c114000.jpg not downloaded yet
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1bb386da4b7ea74e35e1bdd10ef647d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff5b90>
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_8893f6a1165da49fd87e4f74fa614439.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_8893f6a1165da49fd87e4f74fa614439.jpg saved to cache
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_4e993aa271f34fb3398e516621e03293.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_2eaee74c5c693946daf610888856b7bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_2eaee74c5c693946daf610888856b7bb.jpg not downloaded yet
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_dad651cb1e9059b5fad9951696b03bdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_dad651cb1e9059b5fad9951696b03bdb.jpg not downloaded yet
2026-03-28 20:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218
2026-03-28 20:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65e732f-ddab-5322-9b1d-2e479a8f605e with scrape type 1
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d65e732f-ddab-5322-9b1d-2e479a8f605e
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_9e2041dcba3ff1e114ac9a050410ad41.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_9e2041dcba3ff1e114ac9a050410ad41.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_a7cbdd174fe2f918ab2aabaefe91fda5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_a7cbdd174fe2f918ab2aabaefe91fda5.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_1a775574c0b12c3c628afd5a86748f30.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_1a775574c0b12c3c628afd5a86748f30.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_d6dd3310dfc15ef216d8f8c9ff3a61b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_d6dd3310dfc15ef216d8f8c9ff3a61b2.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_a07da612be359878eeaa1415486a53d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_a07da612be359878eeaa1415486a53d3.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_7cb8cc0dd5226807ad96f11466381fa7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_7cb8cc0dd5226807ad96f11466381fa7.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg not downloaded yet
2026-03-28 20:33:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff5550>
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_bd86e20331c507c8a05fa7db43f2db70.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_bd86e20331c507c8a05fa7db43f2db70.jpg saved to cache
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4bd92831731b9e5884b2bb747d0d4736.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_60d9ab6e217770bf4cb55a3e492ae169.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_8ef554d8a99207b0c00b09459d3722a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_8ef554d8a99207b0c00b09459d3722a8.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_106a27d7013227cbc1b4e49fbb856073.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_106a27d7013227cbc1b4e49fbb856073.jpg already downloaded
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_ab4ee8c5c12aaf686814ae615b12d4fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_ab4ee8c5c12aaf686814ae615b12d4fe.jpg already downloaded
2026-03-28 20:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_c6c35bdac715193011181f8cc09ed4ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216fb10>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_1bb386da4b7ea74e35e1bdd10ef647d3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1bb386da4b7ea74e35e1bdd10ef647d3.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179419b10>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_4e993aa271f34fb3398e516621e03293.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_4e993aa271f34fb3398e516621e03293.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff4910>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_4bd92831731b9e5884b2bb747d0d4736.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4bd92831731b9e5884b2bb747d0d4736.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172146cd0>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_60d9ab6e217770bf4cb55a3e492ae169.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_60d9ab6e217770bf4cb55a3e492ae169.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172617850>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_c6c35bdac715193011181f8cc09ed4ab.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_c6c35bdac715193011181f8cc09ed4ab.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_e14ec09e9af8e58590b9db120c83d567.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_994949c3ffd8faefad079ecd6c114000.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU85893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT20121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_2eaee74c5c693946daf610888856b7bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18d7a1c31a7be737009d148701421d30.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_95f0846a4ab65d21134a57d1d541691b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4834bfd7a0dde1b9c4caf1f4061fe89d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_3273f1571a42dde997b27db82cb118f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_c5f92325c64faa42c29bd680ffebe7bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_a3af7ea526d4af49f5042dfa0b4116af.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_facd236f123e819fa55ca3b7dc0e9746.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172147dd0>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_e14ec09e9af8e58590b9db120c83d567.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_e14ec09e9af8e58590b9db120c83d567.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726f1590>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_994949c3ffd8faefad079ecd6c114000.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_994949c3ffd8faefad079ecd6c114000.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726e4650>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_2eaee74c5c693946daf610888856b7bb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_2eaee74c5c693946daf610888856b7bb.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730d37d0>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_18d7a1c31a7be737009d148701421d30.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18d7a1c31a7be737009d148701421d30.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726ab090>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_95f0846a4ab65d21134a57d1d541691b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_95f0846a4ab65d21134a57d1d541691b.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d5b90>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_4834bfd7a0dde1b9c4caf1f4061fe89d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4834bfd7a0dde1b9c4caf1f4061fe89d.jpg saved to cache
2026-03-28 20:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726a8c50>
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_3273f1571a42dde997b27db82cb118f4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_3273f1571a42dde997b27db82cb118f4.jpg saved to cache
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17317e050>
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_c5f92325c64faa42c29bd680ffebe7bb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_c5f92325c64faa42c29bd680ffebe7bb.jpg saved to cache
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726a9190>
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0b%252Fed0b83744db2d0c4ec525fbda9bfd98c%252Fpa%252FUA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg saved to cache
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d65e732f-ddab-5322-9b1d-2e479a8f605e
2026-03-28 20:33:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d65e732f-ddab-5322-9b1d-2e479a8f605e, skipping ID generation
2026-03-28 20:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65e732f-ddab-5322-9b1d-2e479a8f605e with scrape type 1
2026-03-28 20:33:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d65e732f-ddab-5322-9b1d-2e479a8f605e sending to next pipeline
2026-03-28 20:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d65e732f-ddab-5322-9b1d-2e479a8f605e, identifier: UA37218
2026-03-28 20:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218
2026-03-28 20:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218
2026-03-28 20:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218 to the API
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:00Z',
 'fuel_type': 'diesel',
 'id': 'd65e732f-ddab-5322-9b1d-2e479a8f605e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA37218',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 134979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_9e2041dcba3ff1e114ac9a050410ad41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_a7cbdd174fe2f918ab2aabaefe91fda5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_1a775574c0b12c3c628afd5a86748f30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_d6dd3310dfc15ef216d8f8c9ff3a61b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_a07da612be359878eeaa1415486a53d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_7cb8cc0dd5226807ad96f11466381fa7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_b5c9f9bc7e4dfa1a9abaecaea6e8e36f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_8ef554d8a99207b0c00b09459d3722a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2358005,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_106a27d7013227cbc1b4e49fbb856073.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d65e732f-ddab-5322-9b1d-2e479a8f605e/d65e732f-ddab-5322-9b1d-2e479a8f605e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0b/ed0b83744db2d0c4ec525fbda9bfd98c/pa/UA37218_ab4ee8c5c12aaf686814ae615b12d4fe.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 Diesel L Edition L3',
 'transmission': 'manual',
 'trim': 'L Edition L3',
 'year': 2020}
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-28 20:33:02 [auto1.be] INFO: Saving data for UA37218: {'created_time': 1774729982.917112, 'last_price_update_time': 1774729982.917122, 'auction_closing_time': 1774885680.0}
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA37218') HTTP/1.1" 204 0
2026-03-28 20:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_dad651cb1e9059b5fad9951696b03bdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172141ad0>
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_a3af7ea526d4af49f5042dfa0b4116af.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_a3af7ea526d4af49f5042dfa0b4116af.jpg saved to cache
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR09444> (referer: https://www.auto1.com/v1/car-details-view/JR09444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH35268> (referer: https://www.auto1.com/v1/car-details-view/WH35268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa186dd1f90>
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_facd236f123e819fa55ca3b7dc0e9746.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_facd236f123e819fa55ca3b7dc0e9746.jpg saved to cache
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_ae6c73e12dbe5237059f9138135b76f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17a1e3510>
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_dad651cb1e9059b5fad9951696b03bdb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_dad651cb1e9059b5fad9951696b03bdb.jpg saved to cache
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444
2026-03-28 20:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c10758-0dd5-5717-9551-204e3475778d with scrape type 1
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 40c10758-0dd5-5717-9551-204e3475778d
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F72%252F9072efc49d47653f186001822ed963f5%252Fpa%252FJR09444_19e4b9078e29f71c15a952c4746a5acd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_19e4b9078e29f71c15a952c4746a5acd.jpg already downloaded
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F72%252F9072efc49d47653f186001822ed963f5%252Fpa%252FJR09444_d15e45b33bad9492026a009394d0cc3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_d15e45b33bad9492026a009394d0cc3c.jpg already downloaded
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F72%252F9072efc49d47653f186001822ed963f5%252Fpa%252FJR09444_e20eff51569045fcddb73dcc4241e621.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_e20eff51569045fcddb73dcc4241e621.jpg already downloaded
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F72%252F9072efc49d47653f186001822ed963f5%252Fpa%252FJR09444_e00465ba6733bda137911a66addea453.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_e00465ba6733bda137911a66addea453.jpg already downloaded
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F72%252F9072efc49d47653f186001822ed963f5%252Fpa%252FJR09444_b08110a9a6f14f9517efe7db40091d95.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_b08110a9a6f14f9517efe7db40091d95.jpg already downloaded
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F72%252F9072efc49d47653f186001822ed963f5%252Fpa%252FJR09444_7a0e5c73ac61242768dfcb6f260698fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_7a0e5c73ac61242768dfcb6f260698fc.jpg already downloaded
2026-03-28 20:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40c10758-0dd5-5717-9551-204e3475778d, identifier: JR09444
2026-03-28 20:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268
2026-03-28 20:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35350d4-7593-59dd-b84c-706984af7884 with scrape type 1
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_d066ba8a7d27bd68ec4776e505ff3aa0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d066ba8a7d27bd68ec4776e505ff3aa0.jpg not downloaded yet
2026-03-28 20:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444
2026-03-28 20:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444
2026-03-28 20:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444 to the API
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR09444>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'diesel',
 'id': '40c10758-0dd5-5717-9551-204e3475778d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR09444',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 248851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_19e4b9078e29f71c15a952c4746a5acd.jpg',
                'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_d15e45b33bad9492026a009394d0cc3c.jpg',
                'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_e20eff51569045fcddb73dcc4241e621.jpg',
                'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_e00465ba6733bda137911a66addea453.jpg',
                'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_b08110a9a6f14f9517efe7db40091d95.jpg',
                'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_7a0e5c73ac61242768dfcb6f260698fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c10758-0dd5-5717-9551-204e3475778d/40c10758-0dd5-5717-9551-204e3475778d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_19e4b9078e29f71c15a952c4746a5acd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c10758-0dd5-5717-9551-204e3475778d/40c10758-0dd5-5717-9551-204e3475778d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_d15e45b33bad9492026a009394d0cc3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c10758-0dd5-5717-9551-204e3475778d/40c10758-0dd5-5717-9551-204e3475778d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_e20eff51569045fcddb73dcc4241e621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c10758-0dd5-5717-9551-204e3475778d/40c10758-0dd5-5717-9551-204e3475778d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_e00465ba6733bda137911a66addea453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c10758-0dd5-5717-9551-204e3475778d/40c10758-0dd5-5717-9551-204e3475778d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_b08110a9a6f14f9517efe7db40091d95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40c10758-0dd5-5717-9551-204e3475778d/40c10758-0dd5-5717-9551-204e3475778d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/72/9072efc49d47653f186001822ed963f5/pa/JR09444_7a0e5c73ac61242768dfcb6f260698fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Delta 1.6 JTD Silver',
 'transmission': 'manual',
 'trim': 'Silver',
 'year': 2013}
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [auto1.be] INFO: Saving data for JR09444: {'created_time': 1774729983.810799, 'last_price_update_time': 1774729983.810812, 'auction_closing_time': 1774886039.0}
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JR09444') HTTP/1.1" 204 0
2026-03-28 20:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_5f1f15031709bb971531c120f1f37437.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_f26288d4ea4aaef7c7778f01d07dfa23.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_4764b3ec50bdab931b0edef56c41ede1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_4764b3ec50bdab931b0edef56c41ede1.jpg not downloaded yet
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_1d0aaba607841e2a67c287140d03267a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_1d0aaba607841e2a67c287140d03267a.jpg not downloaded yet
2026-03-28 20:33:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:33:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:33:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d8650>
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_ae6c73e12dbe5237059f9138135b76f0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_ae6c73e12dbe5237059f9138135b76f0.jpg saved to cache
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_7d1a394479ac25b5c3060ed712152d07.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7d1a394479ac25b5c3060ed712152d07.jpg not downloaded yet
2026-03-28 20:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL00392> (referer: https://www.auto1.com/v1/car-details-view/HL00392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_7cd7d2b8aeb2e197bca36d50be1032db.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7cd7d2b8aeb2e197bca36d50be1032db.jpg not downloaded yet
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_46f1d0580037745ed884b061d5ff1b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_46f1d0580037745ed884b061d5ff1b6a.jpg not downloaded yet
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172141490>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_5f1f15031709bb971531c120f1f37437.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_5f1f15031709bb971531c120f1f37437.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726fbf10>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_f26288d4ea4aaef7c7778f01d07dfa23.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_f26288d4ea4aaef7c7778f01d07dfa23.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_3d908afef8fd532d7a47dad18faa910c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_081d4abcfa886fe5edc0dd166a28a967.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_081d4abcfa886fe5edc0dd166a28a967.jpg not downloaded yet
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4fe7e81fc0918086040975512abd805d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_6d13fb0347c30c242d9810fb2151e6bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_6d13fb0347c30c242d9810fb2151e6bf.jpg not downloaded yet
2026-03-28 20:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392
2026-03-28 20:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f9f124-4a32-56fd-a559-737a4f7ce145 with scrape type 1
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_07e1390811bea75da70a006a55f872a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_07e1390811bea75da70a006a55f872a5.jpg not downloaded yet
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_703ab4c0da289d7eaf921fb8350a7490.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_703ab4c0da289d7eaf921fb8350a7490.jpg not downloaded yet
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_5eb3e332a93491489af114ca4af824a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_5eb3e332a93491489af114ca4af824a4.jpg not downloaded yet
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d066ba8a7d27bd68ec4776e505ff3aa0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_d569d5fabf3e2718e2f058a82ffa6ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d569d5fabf3e2718e2f058a82ffa6ec8.jpg not downloaded yet
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_441f9c06914b2ea82065d03bb784f35a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_441f9c06914b2ea82065d03bb784f35a.jpg not downloaded yet
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17309e7d0>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_3d908afef8fd532d7a47dad18faa910c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_3d908afef8fd532d7a47dad18faa910c.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_9abba69342a80631addc5dc24e9e006e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_9abba69342a80631addc5dc24e9e006e.jpg not downloaded yet
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173021590>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_4fe7e81fc0918086040975512abd805d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4fe7e81fc0918086040975512abd805d.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a2cd5f0aec7dbc55587b42a6f35d072c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_32d35b3fe6b626dbe8e29bea0ce9c795.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_32d35b3fe6b626dbe8e29bea0ce9c795.jpg not downloaded yet
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17212f190>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_d066ba8a7d27bd68ec4776e505ff3aa0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d066ba8a7d27bd68ec4776e505ff3aa0.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ70860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_e36a5fce83367fa5e47251b899611f6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e36a5fce83367fa5e47251b899611f6a.jpg not downloaded yet
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_e7b872d367a5ecab357a05c62bcc812a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e7b872d367a5ecab357a05c62bcc812a.jpg not downloaded yet
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_2c3486ac40a99dcf17225b7eed21f88a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_2c3486ac40a99dcf17225b7eed21f88a.jpg not downloaded yet
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172561950>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_a2cd5f0aec7dbc55587b42a6f35d072c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a2cd5f0aec7dbc55587b42a6f35d072c.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_c8d19ecdc4555141931aeb1bc97cb6fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_c8d19ecdc4555141931aeb1bc97cb6fc.jpg not downloaded yet
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7d1a394479ac25b5c3060ed712152d07.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_46f1d0580037745ed884b061d5ff1b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_af08319a67dcbe5ca79d9914a10f5c0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_af08319a67dcbe5ca79d9914a10f5c0a.jpg not downloaded yet
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_319eea8d32e4cc9051451f699495d24a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_8008a04f2a15e4b4fe17d8d62871ef06.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_b0ccc6a97863b977b0fe9663b9f8ad50.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a28edd39d3743cd55d277300aa681029.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18205b88c9122f471e3354e4d558ec62.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_0a6970059f01c5c55bc5c3fcc9bb3e9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bca10>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_7d1a394479ac25b5c3060ed712152d07.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7d1a394479ac25b5c3060ed712152d07.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17212cb90>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_46f1d0580037745ed884b061d5ff1b6a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_46f1d0580037745ed884b061d5ff1b6a.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_5eb3e332a93491489af114ca4af824a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7cd7d2b8aeb2e197bca36d50be1032db.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173022d50>
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F5f%252F045fe2b899231b081bfd7c0bddf11da2%252Fpa%252FDW89604_319eea8d32e4cc9051451f699495d24a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_319eea8d32e4cc9051451f699495d24a.jpg saved to cache
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b595d89-6e5d-5199-85ea-67227817cfc8
2026-03-28 20:33:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b595d89-6e5d-5199-85ea-67227817cfc8, skipping ID generation
2026-03-28 20:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b595d89-6e5d-5199-85ea-67227817cfc8 with scrape type 1
2026-03-28 20:33:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b595d89-6e5d-5199-85ea-67227817cfc8 sending to next pipeline
2026-03-28 20:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b595d89-6e5d-5199-85ea-67227817cfc8, identifier: DW89604
2026-03-28 20:33:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731ee9d0>
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_8008a04f2a15e4b4fe17d8d62871ef06.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_8008a04f2a15e4b4fe17d8d62871ef06.jpg saved to cache
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172143f10>
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_b0ccc6a97863b977b0fe9663b9f8ad50.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_b0ccc6a97863b977b0fe9663b9f8ad50.jpg saved to cache
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17315e410>
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_a28edd39d3743cd55d277300aa681029.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a28edd39d3743cd55d277300aa681029.jpg saved to cache
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17303d2d0>
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_18205b88c9122f471e3354e4d558ec62.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18205b88c9122f471e3354e4d558ec62.jpg saved to cache
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b5a50>
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_0a6970059f01c5c55bc5c3fcc9bb3e9f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_0a6970059f01c5c55bc5c3fcc9bb3e9f.jpg saved to cache
2026-03-28 20:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604
2026-03-28 20:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604
2026-03-28 20:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604 to the API
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_319eea8d32e4cc9051451f699495d24a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:25Z',
 'fuel_type': 'petrol',
 'id': '6b595d89-6e5d-5199-85ea-67227817cfc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89604',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 28723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_556893e1b6730598046653788958cfa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_8893f6a1165da49fd87e4f74fa614439.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_4e993aa271f34fb3398e516621e03293.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2255720,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_319eea8d32e4cc9051451f699495d24a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425720,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_c6c35bdac715193011181f8cc09ed4ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 398225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_ae6c73e12dbe5237059f9138135b76f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_e14ec09e9af8e58590b9db120c83d567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_994949c3ffd8faefad079ecd6c114000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_2eaee74c5c693946daf610888856b7bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b595d89-6e5d-5199-85ea-67227817cfc8/6b595d89-6e5d-5199-85ea-67227817cfc8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/5f/045fe2b899231b081bfd7c0bddf11da2/pa/DW89604_dad651cb1e9059b5fad9951696b03bdb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [auto1.be] INFO: Saving data for DW89604: {'created_time': 1774729986.010003, 'last_price_update_time': 1774729986.010015, 'auction_closing_time': 1774883305.0}
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW89604') HTTP/1.1" 204 0
2026-03-28 20:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT20121> (referer: https://www.auto1.com/v1/car-details-view/DT20121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU85893> (referer: https://www.auto1.com/v1/car-details-view/SU85893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN49517> (referer: https://www.auto1.com/v1/car-details-view/GN49517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173001f10>
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_5eb3e332a93491489af114ca4af824a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_5eb3e332a93491489af114ca4af824a4.jpg saved to cache
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173197990>
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_7cd7d2b8aeb2e197bca36d50be1032db.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7cd7d2b8aeb2e197bca36d50be1032db.jpg saved to cache
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121
2026-03-28 20:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b05fc74-4368-558d-8763-3111bcac2038 with scrape type 1
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_99f8e80d9472f97c5d485f3720555f87.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_99f8e80d9472f97c5d485f3720555f87.jpg not downloaded yet
2026-03-28 20:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893
2026-03-28 20:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with scrape type 1
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_e0336ae9ddf259e017377c75ba9013e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_e0336ae9ddf259e017377c75ba9013e1.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_c0296c84ef44b6c6b6027f17c84a3195.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_c0296c84ef44b6c6b6027f17c84a3195.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_a96efd8b03687bd535d9eadf108504a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_a96efd8b03687bd535d9eadf108504a0.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_710e9c81ec546aae41586002e4c2b2ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_710e9c81ec546aae41586002e4c2b2ef.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_fa1f6173d53c0509f2101bf5c36cdbc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_fa1f6173d53c0509f2101bf5c36cdbc5.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_9c2fe7edf99f52ff3e619fd2060fcdd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_9c2fe7edf99f52ff3e619fd2060fcdd6.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_10201d4f81d46eeb646e3a5800474f89.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_10201d4f81d46eeb646e3a5800474f89.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_7875cac8380e14a105249cacb86b3b8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_7875cac8380e14a105249cacb86b3b8f.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_a4fd619528dbf162b541a7e619a21844.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_a4fd619528dbf162b541a7e619a21844.jpg already downloaded
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fd4%252F58d48640a38931a55e5b20827f5f834b%252Fpa%252FSU85893_b65ab27a5208ce2dcffbef710cbd2145.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_b65ab27a5208ce2dcffbef710cbd2145.jpg already downloaded
2026-03-28 20:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc, identifier: SU85893
2026-03-28 20:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 20:33:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 20:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893
2026-03-28 20:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893 to the API
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU85893>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:09:16Z',
 'fuel_type': 'petrol',
 'id': '2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU85893',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 65117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_e0336ae9ddf259e017377c75ba9013e1.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_c0296c84ef44b6c6b6027f17c84a3195.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_a96efd8b03687bd535d9eadf108504a0.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_710e9c81ec546aae41586002e4c2b2ef.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_fa1f6173d53c0509f2101bf5c36cdbc5.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_9c2fe7edf99f52ff3e619fd2060fcdd6.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_10201d4f81d46eeb646e3a5800474f89.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_7875cac8380e14a105249cacb86b3b8f.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_a4fd619528dbf162b541a7e619a21844.jpg',
                'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_b65ab27a5208ce2dcffbef710cbd2145.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_e0336ae9ddf259e017377c75ba9013e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_c0296c84ef44b6c6b6027f17c84a3195.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_a96efd8b03687bd535d9eadf108504a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_710e9c81ec546aae41586002e4c2b2ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_fa1f6173d53c0509f2101bf5c36cdbc5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_9c2fe7edf99f52ff3e619fd2060fcdd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_10201d4f81d46eeb646e3a5800474f89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_7875cac8380e14a105249cacb86b3b8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2353784,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_a4fd619528dbf162b541a7e619a21844.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc/2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/d4/58d48640a38931a55e5b20827f5f834b/pa/SU85893_b65ab27a5208ce2dcffbef710cbd2145.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [auto1.be] INFO: Saving data for SU85893: {'created_time': 1774729987.060092, 'last_price_update_time': 1774729987.060104, 'auction_closing_time': 1774883356.0}
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU85893') HTTP/1.1" 204 0
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_9abba69342a80631addc5dc24e9e006e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_434a212b031705bac8a98cb8f01293b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_434a212b031705bac8a98cb8f01293b0.jpg not downloaded yet
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e36a5fce83367fa5e47251b899611f6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [scrapy.extensions.logstats] INFO: Crawled 167 pages (at 80 pages/min), scraped 135 items (at 43 items/min)
2026-03-28 20:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 192MiB
2026-03-28 20:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517
2026-03-28 20:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a479dc-fc74-5ad9-a245-660f6ef7c604 with scrape type 1
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_c12472d990cf28e2af47e87ff8052a39.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_c12472d990cf28e2af47e87ff8052a39.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_4f98e1e458a9c2446fcf4c04bf613647.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_4f98e1e458a9c2446fcf4c04bf613647.jpg not downloaded yet
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ70860> (referer: https://www.auto1.com/v1/car-details-view/JJ70860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_199494c6c6ce8056e43fcdd7e167d8df.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_199494c6c6ce8056e43fcdd7e167d8df.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_ed5597c5f902d6dc63c8aa8876240932.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_ed5597c5f902d6dc63c8aa8876240932.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_d789d56abfb2e3abca43bcee73923460.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_d789d56abfb2e3abca43bcee73923460.jpg not downloaded yet
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_441f9c06914b2ea82065d03bb784f35a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_1dcb4b5c277458b17131d122d037d38f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_1dcb4b5c277458b17131d122d037d38f.jpg not downloaded yet
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172604c50>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_9abba69342a80631addc5dc24e9e006e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_9abba69342a80631addc5dc24e9e006e.jpg saved to cache
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e7b872d367a5ecab357a05c62bcc812a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_9cc3f680f71c252c5f9db1d60cd40721.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_9cc3f680f71c252c5f9db1d60cd40721.jpg not downloaded yet
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_2c3486ac40a99dcf17225b7eed21f88a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_32d35b3fe6b626dbe8e29bea0ce9c795.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d569d5fabf3e2718e2f058a82ffa6ec8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_a6ae2a2d94c5a7b6a43c6981e166ddcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_a6ae2a2d94c5a7b6a43c6981e166ddcd.jpg not downloaded yet
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173019590>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_e36a5fce83367fa5e47251b899611f6a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e36a5fce83367fa5e47251b899611f6a.jpg saved to cache
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_703ab4c0da289d7eaf921fb8350a7490.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_49808fd78f956196db33c4edca18663b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_49808fd78f956196db33c4edca18663b.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_8a521e83220c0d90d4af52cc53a21384.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_8a521e83220c0d90d4af52cc53a21384.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_f480edbacf94b62b4e9ac859db63747c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_f480edbacf94b62b4e9ac859db63747c.jpg not downloaded yet
2026-03-28 20:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860
2026-03-28 20:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a089f6ec-349f-525e-8589-8c7e4cc37c22 with scrape type 1
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_47e845ac9409ef83bc06e9df0eaa6046.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_47e845ac9409ef83bc06e9df0eaa6046.jpg not downloaded yet
2026-03-28 20:33:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721612d0>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_441f9c06914b2ea82065d03bb784f35a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_441f9c06914b2ea82065d03bb784f35a.jpg saved to cache
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_af08319a67dcbe5ca79d9914a10f5c0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_99f8e80d9472f97c5d485f3720555f87.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_ca91a5e3f6873662f2e1c8b2ee6100f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_ca91a5e3f6873662f2e1c8b2ee6100f6.jpg not downloaded yet
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_588fcd99a4e260bf53ce3bd37f0120ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_588fcd99a4e260bf53ce3bd37f0120ca.jpg not downloaded yet
2026-03-28 20:33:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172173090>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_e7b872d367a5ecab357a05c62bcc812a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e7b872d367a5ecab357a05c62bcc812a.jpg saved to cache
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731080d0>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_2c3486ac40a99dcf17225b7eed21f88a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_2c3486ac40a99dcf17225b7eed21f88a.jpg saved to cache
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173023b50>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_32d35b3fe6b626dbe8e29bea0ce9c795.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_32d35b3fe6b626dbe8e29bea0ce9c795.jpg saved to cache
2026-03-28 20:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172694190>
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_d569d5fabf3e2718e2f058a82ffa6ec8.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d569d5fabf3e2718e2f058a82ffa6ec8.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172172810>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_703ab4c0da289d7eaf921fb8350a7490.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_703ab4c0da289d7eaf921fb8350a7490.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_4764b3ec50bdab931b0edef56c41ede1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_665db5b60e1621545f8e3ccd2da7d302.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_665db5b60e1621545f8e3ccd2da7d302.jpg not downloaded yet
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_4d40a4abe8c9fe2840337810df439dc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4d40a4abe8c9fe2840337810df439dc7.jpg not downloaded yet
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_c12472d990cf28e2af47e87ff8052a39.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_ac466cac7cff8a3664083196b43c2bff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_ac466cac7cff8a3664083196b43c2bff.jpg not downloaded yet
2026-03-28 20:33:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732faed0>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_af08319a67dcbe5ca79d9914a10f5c0a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_af08319a67dcbe5ca79d9914a10f5c0a.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730a96d0>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_99f8e80d9472f97c5d485f3720555f87.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_99f8e80d9472f97c5d485f3720555f87.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_79f539be3e19c95ce59c912c4b3a6025.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_79f539be3e19c95ce59c912c4b3a6025.jpg not downloaded yet
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_ed5597c5f902d6dc63c8aa8876240932.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17256ebd0>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_4764b3ec50bdab931b0edef56c41ede1.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_4764b3ec50bdab931b0edef56c41ede1.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17940df90>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_c12472d990cf28e2af47e87ff8052a39.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_c12472d990cf28e2af47e87ff8052a39.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_1cd6c322a7d0da15d466bbc8be8b4ce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_1cd6c322a7d0da15d466bbc8be8b4ce9.jpg not downloaded yet
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_665db5b60e1621545f8e3ccd2da7d302.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_cab63b89aec0a93fbf4115644272c785.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_cab63b89aec0a93fbf4115644272c785.jpg not downloaded yet
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_2feb7b153980e14af423f4f22528bde0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_2feb7b153980e14af423f4f22528bde0.jpg not downloaded yet
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fe3710>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_ed5597c5f902d6dc63c8aa8876240932.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_ed5597c5f902d6dc63c8aa8876240932.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4d40a4abe8c9fe2840337810df439dc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_300cd7eaa2e540849108c0e2ace10c44.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_300cd7eaa2e540849108c0e2ace10c44.jpg not downloaded yet
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg not downloaded yet
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172571550>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_665db5b60e1621545f8e3ccd2da7d302.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_665db5b60e1621545f8e3ccd2da7d302.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_c8d19ecdc4555141931aeb1bc97cb6fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_47e845ac9409ef83bc06e9df0eaa6046.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_588fcd99a4e260bf53ce3bd37f0120ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731f8e50>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_4d40a4abe8c9fe2840337810df439dc7.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4d40a4abe8c9fe2840337810df439dc7.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_07e1390811bea75da70a006a55f872a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_1d0aaba607841e2a67c287140d03267a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_6d13fb0347c30c242d9810fb2151e6bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_081d4abcfa886fe5edc0dd166a28a967.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_ca91a5e3f6873662f2e1c8b2ee6100f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172156ed0>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_c8d19ecdc4555141931aeb1bc97cb6fc.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_c8d19ecdc4555141931aeb1bc97cb6fc.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_8a521e83220c0d90d4af52cc53a21384.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_49808fd78f956196db33c4edca18663b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_a6ae2a2d94c5a7b6a43c6981e166ddcd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fe3150>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_47e845ac9409ef83bc06e9df0eaa6046.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_47e845ac9409ef83bc06e9df0eaa6046.jpg saved to cache
2026-03-28 20:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173034090>
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_588fcd99a4e260bf53ce3bd37f0120ca.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_588fcd99a4e260bf53ce3bd37f0120ca.jpg saved to cache
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17214a610>
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F5b%252F175bd620f0d864837390b59135357c30%252Fpa%252FHL00392_07e1390811bea75da70a006a55f872a5.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_07e1390811bea75da70a006a55f872a5.jpg saved to cache
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6f9f124-4a32-56fd-a559-737a4f7ce145
2026-03-28 20:33:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6f9f124-4a32-56fd-a559-737a4f7ce145, skipping ID generation
2026-03-28 20:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f9f124-4a32-56fd-a559-737a4f7ce145 with scrape type 1
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6f9f124-4a32-56fd-a559-737a4f7ce145 sending to next pipeline
2026-03-28 20:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6f9f124-4a32-56fd-a559-737a4f7ce145, identifier: HL00392
2026-03-28 20:33:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fc1a10>
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_1d0aaba607841e2a67c287140d03267a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_1d0aaba607841e2a67c287140d03267a.jpg saved to cache
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790dd390>
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_6d13fb0347c30c242d9810fb2151e6bf.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_6d13fb0347c30c242d9810fb2151e6bf.jpg saved to cache
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172695950>
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252Fdc%252F76dcc3469c517a0fb9ba959217f0294d%252Fpa%252FWH35268_081d4abcfa886fe5edc0dd166a28a967.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_081d4abcfa886fe5edc0dd166a28a967.jpg saved to cache
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e35350d4-7593-59dd-b84c-706984af7884
2026-03-28 20:33:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e35350d4-7593-59dd-b84c-706984af7884, skipping ID generation
2026-03-28 20:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35350d4-7593-59dd-b84c-706984af7884 with scrape type 1
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e35350d4-7593-59dd-b84c-706984af7884 sending to next pipeline
2026-03-28 20:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e35350d4-7593-59dd-b84c-706984af7884, identifier: WH35268
2026-03-28 20:33:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fab050>
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_ca91a5e3f6873662f2e1c8b2ee6100f6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_ca91a5e3f6873662f2e1c8b2ee6100f6.jpg saved to cache
2026-03-28 20:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392
2026-03-28 20:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392
2026-03-28 20:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392 to the API
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_07e1390811bea75da70a006a55f872a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:09:28Z',
 'fuel_type': 'diesel',
 'id': 'b6f9f124-4a32-56fd-a559-737a4f7ce145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL00392',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 107150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2254274,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_07e1390811bea75da70a006a55f872a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_5eb3e332a93491489af114ca4af824a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2116539,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_441f9c06914b2ea82065d03bb784f35a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_9abba69342a80631addc5dc24e9e006e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2159260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_32d35b3fe6b626dbe8e29bea0ce9c795.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e36a5fce83367fa5e47251b899611f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2183969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_e7b872d367a5ecab357a05c62bcc812a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2186573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_2c3486ac40a99dcf17225b7eed21f88a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2272148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_c8d19ecdc4555141931aeb1bc97cb6fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9f124-4a32-56fd-a559-737a4f7ce145/b6f9f124-4a32-56fd-a559-737a4f7ce145_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412623,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/5b/175bd620f0d864837390b59135357c30/pa/HL00392_af08319a67dcbe5ca79d9914a10f5c0a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 20d Ingenium Edition',
 'transmission': 'automatic',
 'trim': 'Ingenium Edition',
 'year': 2017}
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-28 20:33:10 [auto1.be] INFO: Saving data for HL00392: {'created_time': 1774729990.332015, 'last_price_update_time': 1774729990.332025, 'auction_closing_time': 1774883368.0}
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL00392') HTTP/1.1" 204 0
2026-03-28 20:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268
2026-03-28 20:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268
2026-03-28 20:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268 to the API
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_081d4abcfa886fe5edc0dd166a28a967.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:16Z',
 'fuel_type': 'diesel',
 'id': 'e35350d4-7593-59dd-b84c-706984af7884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH35268',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 74285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d066ba8a7d27bd68ec4776e505ff3aa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_4764b3ec50bdab931b0edef56c41ede1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570228,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_1d0aaba607841e2a67c287140d03267a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7d1a394479ac25b5c3060ed712152d07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_7cd7d2b8aeb2e197bca36d50be1032db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_46f1d0580037745ed884b061d5ff1b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_081d4abcfa886fe5edc0dd166a28a967.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_6d13fb0347c30c242d9810fb2151e6bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_703ab4c0da289d7eaf921fb8350a7490.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e35350d4-7593-59dd-b84c-706984af7884/e35350d4-7593-59dd-b84c-706984af7884_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/dc/76dcc3469c517a0fb9ba959217f0294d/pa/WH35268_d569d5fabf3e2718e2f058a82ffa6ec8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-28 20:33:10 [auto1.be] INFO: Saving data for WH35268: {'created_time': 1774729990.69535, 'last_price_update_time': 1774729990.695361, 'auction_closing_time': 1774884136.0}
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH35268') HTTP/1.1" 204 0
2026-03-28 20:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_cab63b89aec0a93fbf4115644272c785.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_300cd7eaa2e540849108c0e2ace10c44.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172141f50>
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_8a521e83220c0d90d4af52cc53a21384.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_8a521e83220c0d90d4af52cc53a21384.jpg saved to cache
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172110590>
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_49808fd78f956196db33c4edca18663b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_49808fd78f956196db33c4edca18663b.jpg saved to cache
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172526410>
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_a6ae2a2d94c5a7b6a43c6981e166ddcd.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_a6ae2a2d94c5a7b6a43c6981e166ddcd.jpg saved to cache
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17306be10>
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_cab63b89aec0a93fbf4115644272c785.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_cab63b89aec0a93fbf4115644272c785.jpg saved to cache
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173068410>
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_300cd7eaa2e540849108c0e2ace10c44.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_300cd7eaa2e540849108c0e2ace10c44.jpg saved to cache
2026-03-28 20:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_f480edbacf94b62b4e9ac859db63747c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_1cd6c322a7d0da15d466bbc8be8b4ce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_ac466cac7cff8a3664083196b43c2bff.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_79f539be3e19c95ce59c912c4b3a6025.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_2feb7b153980e14af423f4f22528bde0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_1dcb4b5c277458b17131d122d037d38f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_9cc3f680f71c252c5f9db1d60cd40721.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173004e90>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_f480edbacf94b62b4e9ac859db63747c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_f480edbacf94b62b4e9ac859db63747c.jpg saved to cache
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_daa652d7743cbacc20a962b91ad262d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e4e10>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_1cd6c322a7d0da15d466bbc8be8b4ce9.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_1cd6c322a7d0da15d466bbc8be8b4ce9.jpg saved to cache
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179415350>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_ac466cac7cff8a3664083196b43c2bff.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_ac466cac7cff8a3664083196b43c2bff.jpg saved to cache
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720ab450>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_79f539be3e19c95ce59c912c4b3a6025.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_79f539be3e19c95ce59c912c4b3a6025.jpg saved to cache
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725358d0>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_2feb7b153980e14af423f4f22528bde0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_2feb7b153980e14af423f4f22528bde0.jpg saved to cache
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720a9110>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Ff3%252F8bf3ad6be338d6ae1f049555b9d2c8e6%252Fpa%252FJJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg saved to cache
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a089f6ec-349f-525e-8589-8c7e4cc37c22
2026-03-28 20:33:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a089f6ec-349f-525e-8589-8c7e4cc37c22, skipping ID generation
2026-03-28 20:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a089f6ec-349f-525e-8589-8c7e4cc37c22 with scrape type 1
2026-03-28 20:33:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a089f6ec-349f-525e-8589-8c7e4cc37c22 sending to next pipeline
2026-03-28 20:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a089f6ec-349f-525e-8589-8c7e4cc37c22, identifier: JJ70860
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173f5a8d0>
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_1dcb4b5c277458b17131d122d037d38f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_1dcb4b5c277458b17131d122d037d38f.jpg saved to cache
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730710d0>
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fef%252F8eef459bc50710c889acc5c1c3f1d1d5%252Fpa%252FGN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg saved to cache
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2a479dc-fc74-5ad9-a245-660f6ef7c604
2026-03-28 20:33:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2a479dc-fc74-5ad9-a245-660f6ef7c604, skipping ID generation
2026-03-28 20:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a479dc-fc74-5ad9-a245-660f6ef7c604 with scrape type 1
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2a479dc-fc74-5ad9-a245-660f6ef7c604 sending to next pipeline
2026-03-28 20:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2a479dc-fc74-5ad9-a245-660f6ef7c604, identifier: GN49517
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e4490>
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_9cc3f680f71c252c5f9db1d60cd40721.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_9cc3f680f71c252c5f9db1d60cd40721.jpg saved to cache
2026-03-28 20:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860
2026-03-28 20:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860
2026-03-28 20:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860 to the API
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:57Z',
 'fuel_type': 'petrol',
 'id': 'a089f6ec-349f-525e-8589-8c7e4cc37c22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ70860',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 53262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_47e845ac9409ef83bc06e9df0eaa6046.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_588fcd99a4e260bf53ce3bd37f0120ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4d40a4abe8c9fe2840337810df439dc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3353041,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_ac466cac7cff8a3664083196b43c2bff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_79f539be3e19c95ce59c912c4b3a6025.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3223091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_1cd6c322a7d0da15d466bbc8be8b4ce9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_cab63b89aec0a93fbf4115644272c785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3477291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_2feb7b153980e14af423f4f22528bde0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_300cd7eaa2e540849108c0e2ace10c44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a089f6ec-349f-525e-8589-8c7e4cc37c22/a089f6ec-349f-525e-8589-8c7e4cc37c22_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3626403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/f3/8bf3ad6be338d6ae1f049555b9d2c8e6/pa/JJ70860_4477a04d2ac7cf38cb61c308aecd9384.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-28 20:33:12 [auto1.be] INFO: Saving data for JJ70860: {'created_time': 1774729992.608288, 'last_price_update_time': 1774729992.608301, 'auction_closing_time': 1774884597.0}
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ70860') HTTP/1.1" 204 0
2026-03-28 20:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517
2026-03-28 20:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517
2026-03-28 20:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517 to the API
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:07Z',
 'fuel_type': 'diesel',
 'id': 'e2a479dc-fc74-5ad9-a245-660f6ef7c604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN49517',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 170201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_c12472d990cf28e2af47e87ff8052a39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_0d55d8bdc3034964c3dfc827a01e19fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_ed5597c5f902d6dc63c8aa8876240932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_1dcb4b5c277458b17131d122d037d38f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_a6ae2a2d94c5a7b6a43c6981e166ddcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2a479dc-fc74-5ad9-a245-660f6ef7c604/e2a479dc-fc74-5ad9-a245-660f6ef7c604_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/ef/8eef459bc50710c889acc5c1c3f1d1d5/pa/GN49517_8a521e83220c0d90d4af52cc53a21384.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 DI-D Instyle',
 'transmission': 'manual',
 'trim': 'Instyle',
 'year': 2007}
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-28 20:33:12 [auto1.be] INFO: Saving data for GN49517: {'created_time': 1774729992.961431, 'last_price_update_time': 1774729992.961444, 'auction_closing_time': 1774885867.0}
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN49517') HTTP/1.1" 204 0
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173109a50>
2026-03-28 20:33:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_daa652d7743cbacc20a962b91ad262d0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_daa652d7743cbacc20a962b91ad262d0.jpg saved to cache
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_4f98e1e458a9c2446fcf4c04bf613647.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_199494c6c6ce8056e43fcdd7e167d8df.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_434a212b031705bac8a98cb8f01293b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_cdff795ffe6105a0b670b9b4b5ed862a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_d789d56abfb2e3abca43bcee73923460.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_57362b76a50706564f64f05b309526d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_b972a7ba32a0f86ea6e659dcfe21a1c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_2c7f5d0aca2510593d12a822a0c78d78.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa186dc5d90>
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_4f98e1e458a9c2446fcf4c04bf613647.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_4f98e1e458a9c2446fcf4c04bf613647.jpg saved to cache
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_80c2f21d071de90c136dbac6c055057f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_c3253a77ebf8f81806bbf417c8523fd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_115661da6bea14118121aac615165f6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1b9018a9d80350abd479275a5d3790fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_af6fd17a503bc2c427ad823fa35bcd48.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726fb390>
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_199494c6c6ce8056e43fcdd7e167d8df.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_199494c6c6ce8056e43fcdd7e167d8df.jpg saved to cache
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726fb7d0>
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_434a212b031705bac8a98cb8f01293b0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_434a212b031705bac8a98cb8f01293b0.jpg saved to cache
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730aba50>
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_cdff795ffe6105a0b670b9b4b5ed862a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_cdff795ffe6105a0b670b9b4b5ed862a.jpg saved to cache
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172572410>
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F29%252F65290d6134b2b19978e109b49e92b2ba%252Fpa%252FDT20121_d789d56abfb2e3abca43bcee73923460.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_d789d56abfb2e3abca43bcee73923460.jpg saved to cache
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b05fc74-4368-558d-8763-3111bcac2038
2026-03-28 20:33:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b05fc74-4368-558d-8763-3111bcac2038, skipping ID generation
2026-03-28 20:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b05fc74-4368-558d-8763-3111bcac2038 with scrape type 1
2026-03-28 20:33:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b05fc74-4368-558d-8763-3111bcac2038 sending to next pipeline
2026-03-28 20:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b05fc74-4368-558d-8763-3111bcac2038, identifier: DT20121
2026-03-28 20:33:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa186dc6750>
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_57362b76a50706564f64f05b309526d6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_57362b76a50706564f64f05b309526d6.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308cf10>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_b972a7ba32a0f86ea6e659dcfe21a1c0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_b972a7ba32a0f86ea6e659dcfe21a1c0.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17310b450>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_2c7f5d0aca2510593d12a822a0c78d78.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_2c7f5d0aca2510593d12a822a0c78d78.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121
2026-03-28 20:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121
2026-03-28 20:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121 to the API
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_d789d56abfb2e3abca43bcee73923460.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:14Z',
 'fuel_type': 'diesel',
 'id': '9b05fc74-4368-558d-8763-3111bcac2038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT20121',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Volvo',
 'model': 'C70',
 'odometer': 204567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_99f8e80d9472f97c5d485f3720555f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_434a212b031705bac8a98cb8f01293b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2772864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_4f98e1e458a9c2446fcf4c04bf613647.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_199494c6c6ce8056e43fcdd7e167d8df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2903503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_d789d56abfb2e3abca43bcee73923460.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_9cc3f680f71c252c5f9db1d60cd40721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_49808fd78f956196db33c4edca18663b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2855538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_f480edbacf94b62b4e9ac859db63747c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847228,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_ca91a5e3f6873662f2e1c8b2ee6100f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b05fc74-4368-558d-8763-3111bcac2038/9b05fc74-4368-558d-8763-3111bcac2038_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/29/65290d6134b2b19978e109b49e92b2ba/pa/DT20121_665db5b60e1621545f8e3ccd2da7d302.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volvo C70 2.0 D3 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2011}
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-28 20:33:14 [auto1.be] INFO: Saving data for DT20121: {'created_time': 1774729994.476414, 'last_price_update_time': 1774729994.476424, 'auction_closing_time': 1774883954.0}
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT20121') HTTP/1.1" 204 0
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17309f150>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_80c2f21d071de90c136dbac6c055057f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_80c2f21d071de90c136dbac6c055057f.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732d49d0>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_c3253a77ebf8f81806bbf417c8523fd3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_c3253a77ebf8f81806bbf417c8523fd3.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17210e110>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_115661da6bea14118121aac615165f6c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_115661da6bea14118121aac615165f6c.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726ea190>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F85%252F7285b0c25ada5fb94e7a4d49a53f4eca%252Fpa%252FER91021_1b9018a9d80350abd479275a5d3790fe.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1b9018a9d80350abd479275a5d3790fe.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f139f460-7c0e-5587-909d-b55d1a4b326e
2026-03-28 20:33:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f139f460-7c0e-5587-909d-b55d1a4b326e, skipping ID generation
2026-03-28 20:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f139f460-7c0e-5587-909d-b55d1a4b326e with scrape type 1
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f139f460-7c0e-5587-909d-b55d1a4b326e sending to next pipeline
2026-03-28 20:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f139f460-7c0e-5587-909d-b55d1a4b326e, identifier: ER91021
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17912bdd0>
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_af6fd17a503bc2c427ad823fa35bcd48.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_af6fd17a503bc2c427ad823fa35bcd48.jpg saved to cache
2026-03-28 20:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021
2026-03-28 20:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021
2026-03-28 20:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021 to the API
2026-03-28 20:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1b9018a9d80350abd479275a5d3790fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:26:03Z',
 'fuel_type': 'diesel',
 'id': 'f139f460-7c0e-5587-909d-b55d1a4b326e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER91021',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 184786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1b9018a9d80350abd479275a5d3790fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_318c9942e336d759135f9e9801f9e5ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_b972a7ba32a0f86ea6e659dcfe21a1c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_daa652d7743cbacc20a962b91ad262d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314391,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_bd86e20331c507c8a05fa7db43f2db70.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_5f1f15031709bb971531c120f1f37437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_f26288d4ea4aaef7c7778f01d07dfa23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_1bb386da4b7ea74e35e1bdd10ef647d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_60d9ab6e217770bf4cb55a3e492ae169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f139f460-7c0e-5587-909d-b55d1a4b326e/f139f460-7c0e-5587-909d-b55d1a4b326e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305392,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img72/85/7285b0c25ada5fb94e7a4d49a53f4eca/pa/ER91021_a3af7ea526d4af49f5042dfa0b4116af.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2015}
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-28 20:33:15 [auto1.be] INFO: Saving data for ER91021: {'created_time': 1774729995.239772, 'last_price_update_time': 1774729995.239828, 'auction_closing_time': 1774884363.0}
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER91021') HTTP/1.1" 204 0
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_7b4e84863152a193f140bf828c88450c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_64597a16012e44267beb3a873462ebf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_1d2c9697fddc31eae4b44882e3b8cdb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_9bdc89c4fdc45e3d6f24b35f5fbe9a28.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_e93c8957c8b496ea334daac0beb6e405.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_508be3a1034696d15ad16ee978c7e42c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_64b8c7ebbc3d29caea67d31cf4c8ceb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_84084621db628ff1468d7791e3dc1aff.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_16e05547232b6cfc0854f0162d5f840e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6f6c86d911d921741c1c76c7db76ef5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_e30ed2b95ce1727a4ea352168ba31fe1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_96cc0404638274781a6f9eb12703aea2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173291c90>
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_7b4e84863152a193f140bf828c88450c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_7b4e84863152a193f140bf828c88450c.jpg saved to cache
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173293150>
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_64597a16012e44267beb3a873462ebf0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_64597a16012e44267beb3a873462ebf0.jpg saved to cache
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_8c03db3329da6f0b561d43037d7fac47.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172677ad0>
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_1d2c9697fddc31eae4b44882e3b8cdb1.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_1d2c9697fddc31eae4b44882e3b8cdb1.jpg saved to cache
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730d1890>
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_9bdc89c4fdc45e3d6f24b35f5fbe9a28.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_9bdc89c4fdc45e3d6f24b35f5fbe9a28.jpg saved to cache
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fa1b50>
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_e93c8957c8b496ea334daac0beb6e405.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_e93c8957c8b496ea334daac0beb6e405.jpg saved to cache
2026-03-28 20:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730d2210>
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_508be3a1034696d15ad16ee978c7e42c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_508be3a1034696d15ad16ee978c7e42c.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172522990>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_64b8c7ebbc3d29caea67d31cf4c8ceb6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_64b8c7ebbc3d29caea67d31cf4c8ceb6.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172504550>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_84084621db628ff1468d7791e3dc1aff.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_84084621db628ff1468d7791e3dc1aff.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730be510>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F05%252F760564465b5b5ca92f2bda8fa90fd6d5%252Fpa%252FDZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 293849fa-2ab7-506d-935d-9c24abc49862
2026-03-28 20:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 293849fa-2ab7-506d-935d-9c24abc49862, skipping ID generation
2026-03-28 20:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293849fa-2ab7-506d-935d-9c24abc49862 with scrape type 1
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 293849fa-2ab7-506d-935d-9c24abc49862 sending to next pipeline
2026-03-28 20:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 293849fa-2ab7-506d-935d-9c24abc49862, identifier: DZ29736
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308e750>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F0c%252F540c0c4399a85e2bb7602a3942c45c02%252Fpa%252FAY92488_16e05547232b6cfc0854f0162d5f840e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_16e05547232b6cfc0854f0162d5f840e.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d2b7495-0d90-542a-8905-9bebf4522d2d
2026-03-28 20:33:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d2b7495-0d90-542a-8905-9bebf4522d2d, skipping ID generation
2026-03-28 20:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2b7495-0d90-542a-8905-9bebf4522d2d with scrape type 1
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d2b7495-0d90-542a-8905-9bebf4522d2d sending to next pipeline
2026-03-28 20:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d2b7495-0d90-542a-8905-9bebf4522d2d, identifier: AY92488
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726727d0>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_6f6c86d911d921741c1c76c7db76ef5e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6f6c86d911d921741c1c76c7db76ef5e.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:33:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172149010>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_e30ed2b95ce1727a4ea352168ba31fe1.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_e30ed2b95ce1727a4ea352168ba31fe1.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730c9550>
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_96cc0404638274781a6f9eb12703aea2.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_96cc0404638274781a6f9eb12703aea2.jpg saved to cache
2026-03-28 20:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736
2026-03-28 20:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736
2026-03-28 20:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736 to the API
2026-03-28 20:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:37Z',
 'fuel_type': 'diesel',
 'id': '293849fa-2ab7-506d-935d-9c24abc49862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ29736',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_913228d7bcb8a214eed15cc0e8955cc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_508be3a1034696d15ad16ee978c7e42c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_9bdc89c4fdc45e3d6f24b35f5fbe9a28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2266096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_1d2c9697fddc31eae4b44882e3b8cdb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18d7a1c31a7be737009d148701421d30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_cdff795ffe6105a0b670b9b4b5ed862a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_3d908afef8fd532d7a47dad18faa910c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729332,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_18205b88c9122f471e3354e4d558ec62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_8008a04f2a15e4b4fe17d8d62871ef06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_293849fa-2ab7-506d-935d-9c24abc49862/293849fa-2ab7-506d-935d-9c24abc49862_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/05/760564465b5b5ca92f2bda8fa90fd6d5/pa/DZ29736_facd236f123e819fa55ca3b7dc0e9746.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 d BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueTEC Avantgarde',
 'year': 2016}
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-28 20:33:17 [auto1.be] INFO: Saving data for DZ29736: {'created_time': 1774729997.260891, 'last_price_update_time': 1774729997.260901, 'auction_closing_time': 1774883857.0}
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ29736') HTTP/1.1" 204 0
2026-03-28 20:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488
2026-03-28 20:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488
2026-03-28 20:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488 to the API
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_16e05547232b6cfc0854f0162d5f840e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'petrol',
 'id': '7d2b7495-0d90-542a-8905-9bebf4522d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY92488',
 'listing': 'auction',
 'location': 'BE, Messancy',
 'make': 'BMW',
 'model': '1er',
 'odometer': 62043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_16e05547232b6cfc0854f0162d5f840e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_64b8c7ebbc3d29caea67d31cf4c8ceb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617612,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_e93c8957c8b496ea334daac0beb6e405.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_95f0846a4ab65d21134a57d1d541691b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4834bfd7a0dde1b9c4caf1f4061fe89d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a2cd5f0aec7dbc55587b42a6f35d072c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4fe7e81fc0918086040975512abd805d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2569698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_a28edd39d3743cd55d277300aa681029.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2530778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_b0ccc6a97863b977b0fe9663b9f8ad50.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2b7495-0d90-542a-8905-9bebf4522d2d/7d2b7495-0d90-542a-8905-9bebf4522d2d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/0c/540c0c4399a85e2bb7602a3942c45c02/pa/AY92488_4bd92831731b9e5884b2bb747d0d4736.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2020}
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-28 20:33:17 [auto1.be] INFO: Saving data for AY92488: {'created_time': 1774729997.656774, 'last_price_update_time': 1774729997.656783, 'auction_closing_time': 1774882838.0}
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY92488') HTTP/1.1" 204 0
2026-03-28 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726f1f10>
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_8c03db3329da6f0b561d43037d7fac47.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_8c03db3329da6f0b561d43037d7fac47.jpg saved to cache
2026-03-28 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_f61e9d6f2a90895363243f3efce78002.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_696ca61cfd0623dcfe9968965330b1f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_a60c2634c79e652a9c0492a459d6ef61.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_52c937d049834acf5a60b0b7481401d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6479dd96a48ed0a3c07f3e1c4e3f43b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6dcff50ae1cc16357bea45d078e5e3b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_1c26d946146ca65007bf7dbb8d48d2e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731b0710>
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_f61e9d6f2a90895363243f3efce78002.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_f61e9d6f2a90895363243f3efce78002.jpg saved to cache
2026-03-28 20:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17210ca50>
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_696ca61cfd0623dcfe9968965330b1f8.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_696ca61cfd0623dcfe9968965330b1f8.jpg saved to cache
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726848d0>
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F7d%252F097d42e7b2758ef2533e7d26fc311173%252Fpa%252FJB30712_a60c2634c79e652a9c0492a459d6ef61.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_a60c2634c79e652a9c0492a459d6ef61.jpg saved to cache
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0957ddb1-4635-5fc3-b0b3-38d43f946675
2026-03-28 20:33:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0957ddb1-4635-5fc3-b0b3-38d43f946675, skipping ID generation
2026-03-28 20:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0957ddb1-4635-5fc3-b0b3-38d43f946675 with scrape type 1
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0957ddb1-4635-5fc3-b0b3-38d43f946675 sending to next pipeline
2026-03-28 20:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0957ddb1-4635-5fc3-b0b3-38d43f946675, identifier: JB30712
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720dd010>
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_52c937d049834acf5a60b0b7481401d6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_52c937d049834acf5a60b0b7481401d6.jpg saved to cache
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17941a950>
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_6479dd96a48ed0a3c07f3e1c4e3f43b0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6479dd96a48ed0a3c07f3e1c4e3f43b0.jpg saved to cache
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173006c90>
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_6dcff50ae1cc16357bea45d078e5e3b3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6dcff50ae1cc16357bea45d078e5e3b3.jpg saved to cache
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 20:33:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172685650>
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_1c26d946146ca65007bf7dbb8d48d2e6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_1c26d946146ca65007bf7dbb8d48d2e6.jpg saved to cache
2026-03-28 20:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712
2026-03-28 20:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712
2026-03-28 20:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712 to the API
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_a60c2634c79e652a9c0492a459d6ef61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:55:17Z',
 'fuel_type': 'petrol',
 'id': '0957ddb1-4635-5fc3-b0b3-38d43f946675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB30712',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 92523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_96cc0404638274781a6f9eb12703aea2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2958182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_f61e9d6f2a90895363243f3efce78002.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3169398,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_a60c2634c79e652a9c0492a459d6ef61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_75a54ac8d32ac65dfaa64d86659b8793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2996674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_84084621db628ff1468d7791e3dc1aff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_3273f1571a42dde997b27db82cb118f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_af6fd17a503bc2c427ad823fa35bcd48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3043787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_57362b76a50706564f64f05b309526d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_c5f92325c64faa42c29bd680ffebe7bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957ddb1-4635-5fc3-b0b3-38d43f946675/0957ddb1-4635-5fc3-b0b3-38d43f946675_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819476,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/7d/097d42e7b2758ef2533e7d26fc311173/pa/JB30712_0a6970059f01c5c55bc5c3fcc9bb3e9f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-28 20:33:19 [auto1.be] INFO: Saving data for JB30712: {'created_time': 1774729999.027249, 'last_price_update_time': 1774729999.027259, 'auction_closing_time': 1774886117.0}
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB30712') HTTP/1.1" 204 0
2026-03-28 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM21252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG93945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY27001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT92464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM76060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1792885d0>
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F59%252F40594e2bfb53c751d795d9ac0ba2b4aa%252Fpa%252FXT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg saved to cache
2026-03-28 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e12fc53b-c065-5571-8c64-bac63f333f11
2026-03-28 20:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e12fc53b-c065-5571-8c64-bac63f333f11, skipping ID generation
2026-03-28 20:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12fc53b-c065-5571-8c64-bac63f333f11 with scrape type 1
2026-03-28 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e12fc53b-c065-5571-8c64-bac63f333f11 sending to next pipeline
2026-03-28 20:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e12fc53b-c065-5571-8c64-bac63f333f11, identifier: XT95399
2026-03-28 20:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399
2026-03-28 20:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399
2026-03-28 20:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399 to the API
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6C',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:39Z',
 'fuel_type': 'diesel',
 'id': 'e12fc53b-c065-5571-8c64-bac63f333f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT95399',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 126892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318533,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6479dd96a48ed0a3c07f3e1c4e3f43b0.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318871,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6dcff50ae1cc16357bea45d078e5e3b3.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328712,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_98a8e11b837d2ef02f289a522e659379.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_d2a28daccee36651c7f1bb8fb0176e63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319356,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_6f6c86d911d921741c1c76c7db76ef5e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 303167,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_1c6a5fafe9373bd37d4100ba94f75e87.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319691,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_8c03db3329da6f0b561d43037d7fac47.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_64597a16012e44267beb3a873462ebf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314628,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_115661da6bea14118121aac615165f6c.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12fc53b-c065-5571-8c64-bac63f333f11/e12fc53b-c065-5571-8c64-bac63f333f11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311209,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img40/59/40594e2bfb53c751d795d9ac0ba2b4aa/pa/XT95399_c3253a77ebf8f81806bbf417c8523fd3.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-28 20:33:19 [auto1.be] INFO: Saving data for XT95399: {'created_time': 1774729999.552872, 'last_price_update_time': 1774729999.552884, 'auction_closing_time': 1774885419.0}
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT95399') HTTP/1.1" 204 0
2026-03-28 20:33:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_010018354afb1eb5ad11614f39530c6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732e7810>
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fca%252F14caeb646219ba3189cff2f0f3c12eb4%252Fpa%252FZA12378_010018354afb1eb5ad11614f39530c6e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_010018354afb1eb5ad11614f39530c6e.jpg saved to cache
2026-03-28 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8
2026-03-28 20:33:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8, skipping ID generation
2026-03-28 20:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with scrape type 1
2026-03-28 20:33:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 sending to next pipeline
2026-03-28 20:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8, identifier: ZA12378
2026-03-28 20:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378
2026-03-28 20:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378
2026-03-28 20:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378 to the API
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_010018354afb1eb5ad11614f39530c6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:30:22Z',
 'fuel_type': 'diesel',
 'id': '15a73ce5-f4a7-5335-9066-4ffe26b9dfb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA12378',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 238854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_1c26d946146ca65007bf7dbb8d48d2e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_52c937d049834acf5a60b0b7481401d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_81d9a314c3ae7b5abbe8b6881b3a309c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2887728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_010018354afb1eb5ad11614f39530c6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_e30ed2b95ce1727a4ea352168ba31fe1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365824,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_d749660f9d837265a7df1624d461a89c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_696ca61cfd0623dcfe9968965330b1f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_7b4e84863152a193f140bf828c88450c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_2c7f5d0aca2510593d12a822a0c78d78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a73ce5-f4a7-5335-9066-4ffe26b9dfb8/15a73ce5-f4a7-5335-9066-4ffe26b9dfb8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319654,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/ca/14caeb646219ba3189cff2f0f3c12eb4/pa/ZA12378_80c2f21d071de90c136dbac6c055057f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [auto1.be] INFO: Saving data for ZA12378: {'created_time': 1774730000.321149, 'last_price_update_time': 1774730000.32116, 'auction_closing_time': 1774884622.0}
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZA12378') HTTP/1.1" 204 0
2026-03-28 20:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN30582> (referer: https://www.auto1.com/v1/car-details-view/ZN30582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU29077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582
2026-03-28 20:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7cc53d-141f-5a8a-ba9f-c466980f1059 with scrape type 1
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_29a14263c72fa893a5ffd93a155266fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_29a14263c72fa893a5ffd93a155266fe.jpg not downloaded yet
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_89b5499719f719d11b760ab3bfc29a17.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_89b5499719f719d11b760ab3bfc29a17.jpg not downloaded yet
2026-03-28 20:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF94112> (referer: https://www.auto1.com/v1/car-details-view/PF94112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_f8a81490c2bf6a2677dbd2420971e991.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_f8a81490c2bf6a2677dbd2420971e991.jpg not downloaded yet
2026-03-28 20:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_8d57003bf6256172596ed370be509204.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_8d57003bf6256172596ed370be509204.jpg not downloaded yet
2026-03-28 20:33:20 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1094 | hits on page: 40
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_dc74ffe44d44e3174ba5dfaf649fe572.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_dc74ffe44d44e3174ba5dfaf649fe572.jpg not downloaded yet
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [auto1.be] INFO: Scrape type for TJ00131: 1
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg not downloaded yet
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [auto1.be] INFO: Scrape type for VY36246: 1
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_34bb88201f36d9434463a477c3bf3fba.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_34bb88201f36d9434463a477c3bf3fba.jpg not downloaded yet
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [auto1.be] INFO: Scrape type for MJ04907: 1
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_5b2d6027daf47442c83d1b846aabc608.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_5b2d6027daf47442c83d1b846aabc608.jpg not downloaded yet
2026-03-28 20:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112
2026-03-28 20:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with scrape type 1
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg not downloaded yet
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [auto1.be] INFO: Scrape type for YG03175: 1
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_d757c2beeebe581f1a12aad09f8f104a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_d757c2beeebe581f1a12aad09f8f104a.jpg not downloaded yet
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_3c6fa5ab3d35bc00fdd794e9f99724fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_3c6fa5ab3d35bc00fdd794e9f99724fa.jpg not downloaded yet
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-28 20:33:20 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [auto1.be] INFO: Scrape type for UG65181: 2
2026-03-28 20:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181
2026-03-28 20:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c78281b6-f6c1-5312-85fe-0ee22fa70334 with scrape type 2
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c78281b6-f6c1-5312-85fe-0ee22fa70334 with scrape type 2
2026-03-28 20:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c78281b6-f6c1-5312-85fe-0ee22fa70334, identifier: UG65181
2026-03-28 20:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_f8a81490c2bf6a2677dbd2420971e991.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_1e7b7cafce71e05cde67d74da5cb927f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_1e7b7cafce71e05cde67d74da5cb927f.jpg not downloaded yet
2026-03-28 20:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181
2026-03-28 20:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181
2026-03-28 20:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181 to the API
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:57:07Z',
 'fuel_type': 'diesel',
 'id': 'c78281b6-f6c1-5312-85fe-0ee22fa70334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG65181',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Saving data for UG65181: {'auction_closing_time': 1774886227.0, 'created_time': 1773348519.032579, 'last_price_update_time': 1774730001.258424}
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UG65181') HTTP/1.1" 204 0
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_5ad081153fcf960be6aaa3c9e071c396.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_5ad081153fcf960be6aaa3c9e071c396.jpg not downloaded yet
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for KT35610: 1
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_c687635c1b256bf892ae197f899d97f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_c687635c1b256bf892ae197f899d97f4.jpg not downloaded yet
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD86163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for GH80996: 1
2026-03-28 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY27001> (referer: https://www.auto1.com/v1/car-details-view/UY27001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM76060> (referer: https://www.auto1.com/v1/car-details-view/VM76060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173014b90>
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_f8a81490c2bf6a2677dbd2420971e991.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_f8a81490c2bf6a2677dbd2420971e991.jpg saved to cache
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_66ce370893a676fca6d4554b7415894e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_66ce370893a676fca6d4554b7415894e.jpg not downloaded yet
2026-03-28 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for ZY24236: 1
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_3c6fa5ab3d35bc00fdd794e9f99724fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_255b40792ff565b5805f5b7ef2895bd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_255b40792ff565b5805f5b7ef2895bd4.jpg not downloaded yet
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for ZZ74713: 1
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_ab3262f79d1733a55905f317affc9b41.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_ab3262f79d1733a55905f317affc9b41.jpg not downloaded yet
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for XD67660: 1
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT92464> (referer: https://www.auto1.com/v1/car-details-view/BT92464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001
2026-03-28 20:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419d2c8c-fda5-5957-a21d-11003767f16f with scrape type 1
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_647982c76aea5cd2856bc52bd72e5e8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_647982c76aea5cd2856bc52bd72e5e8b.jpg not downloaded yet
2026-03-28 20:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060
2026-03-28 20:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with scrape type 1
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_c658b28b8a149eece0e1f0c5982eefbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_c658b28b8a149eece0e1f0c5982eefbb.jpg not downloaded yet
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_44e21d18f28e946c9f1d4977880774fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_44e21d18f28e946c9f1d4977880774fd.jpg not downloaded yet
2026-03-28 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for DT55223: 1
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_e49577885280420566a8034e89299644.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e49577885280420566a8034e89299644.jpg not downloaded yet
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_b979a4a70539bcb6f1e7091cffa2dc5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_b979a4a70539bcb6f1e7091cffa2dc5f.jpg not downloaded yet
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_66ce370893a676fca6d4554b7415894e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_a993a28f0534b2a15938e70730337600.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a993a28f0534b2a15938e70730337600.jpg not downloaded yet
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG93945> (referer: https://www.auto1.com/v1/car-details-view/KG93945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_c687635c1b256bf892ae197f899d97f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:21 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [auto1.be] INFO: Scrape type for EL95031: 1
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg not downloaded yet
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_3c22321a515512295e1c74afb39156da.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_3c22321a515512295e1c74afb39156da.jpg not downloaded yet
2026-03-28 20:33:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17941f310>
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_3c6fa5ab3d35bc00fdd794e9f99724fa.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_3c6fa5ab3d35bc00fdd794e9f99724fa.jpg saved to cache
2026-03-28 20:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_a015d08b71cafefc923b855c8f9c038b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a015d08b71cafefc923b855c8f9c038b.jpg not downloaded yet
2026-03-28 20:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464
2026-03-28 20:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c54f33-0575-5e02-a335-a810a3592be1 with scrape type 1
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_a15a67e3966e9c13464f583486b426d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a15a67e3966e9c13464f583486b426d3.jpg not downloaded yet
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for UX01518: 1
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_e8b0d74bb007bc12d07506aad6bce6fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e8b0d74bb007bc12d07506aad6bce6fb.jpg not downloaded yet
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_4664c46238d546b689881637c760469d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4664c46238d546b689881637c760469d.jpg not downloaded yet
2026-03-28 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_c658b28b8a149eece0e1f0c5982eefbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_855d7c95eba3eee955a4413cd6a52fca.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_855d7c95eba3eee955a4413cd6a52fca.jpg not downloaded yet
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308e5d0>
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_66ce370893a676fca6d4554b7415894e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_66ce370893a676fca6d4554b7415894e.jpg saved to cache
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945
2026-03-28 20:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with scrape type 1
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56f53961-7f04-5e27-af0e-1c82ddbc1cc7
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_587264892087126d830b62f81d1077db.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_587264892087126d830b62f81d1077db.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_0313dd18147b594c6b611ab27cb0b70a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_0313dd18147b594c6b611ab27cb0b70a.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_aa4a89eb13ce8f2a5bf14bb04720a6c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_aa4a89eb13ce8f2a5bf14bb04720a6c8.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_6492cc196f0bbec890af387b0f4d31b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_6492cc196f0bbec890af387b0f4d31b5.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_659221cb04a3ced5358a92a3caa64c57.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_659221cb04a3ced5358a92a3caa64c57.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_f3387e66d25f2dadbd3dc93f704a57c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_f3387e66d25f2dadbd3dc93f704a57c0.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_3bc9daf4dbe522eeab29471e53ec1475.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_3bc9daf4dbe522eeab29471e53ec1475.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_46c8a886585ea22c0d8b52d72c7037c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_46c8a886585ea22c0d8b52d72c7037c5.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_cbe6280912b9312e0e20b404504adc5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_cbe6280912b9312e0e20b404504adc5c.jpg already downloaded
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb5%252Fb8b589fa2ee401474ad8a0a9eb887bf2%252Fpa%252FKG93945_e38b8241419ae522c99fab61b044d700.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_e38b8241419ae522c99fab61b044d700.jpg already downloaded
2026-03-28 20:33:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7, identifier: KG93945
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172133650>
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_c687635c1b256bf892ae197f899d97f4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_c687635c1b256bf892ae197f899d97f4.jpg saved to cache
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_44e21d18f28e946c9f1d4977880774fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for EK14732: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for UR02836: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for VX51166: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for BD29807: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for ZJ26009: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for LR36013: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [auto1.be] INFO: Scrape type for TX50404: 0
2026-03-28 20:33:22 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_78103d5e7b555cb793a92ab8179704bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_78103d5e7b555cb793a92ab8179704bb.jpg not downloaded yet
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_4776c20da0b966daa1a30c03d15bc203.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4776c20da0b966daa1a30c03d15bc203.jpg not downloaded yet
2026-03-28 20:33:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945
2026-03-28 20:33:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945
2026-03-28 20:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945 to the API
2026-03-28 20:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG93945>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:51Z',
 'fuel_type': 'petrol',
 'id': '56f53961-7f04-5e27-af0e-1c82ddbc1cc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG93945',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 21904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_587264892087126d830b62f81d1077db.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_0313dd18147b594c6b611ab27cb0b70a.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_aa4a89eb13ce8f2a5bf14bb04720a6c8.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_6492cc196f0bbec890af387b0f4d31b5.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_659221cb04a3ced5358a92a3caa64c57.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_f3387e66d25f2dadbd3dc93f704a57c0.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_3bc9daf4dbe522eeab29471e53ec1475.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_46c8a886585ea22c0d8b52d72c7037c5.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_cbe6280912b9312e0e20b404504adc5c.jpg',
                'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_e38b8241419ae522c99fab61b044d700.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3614689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_587264892087126d830b62f81d1077db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_0313dd18147b594c6b611ab27cb0b70a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_aa4a89eb13ce8f2a5bf14bb04720a6c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3464192,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_6492cc196f0bbec890af387b0f4d31b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3289617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_659221cb04a3ced5358a92a3caa64c57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_f3387e66d25f2dadbd3dc93f704a57c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_3bc9daf4dbe522eeab29471e53ec1475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3715368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_46c8a886585ea22c0d8b52d72c7037c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_cbe6280912b9312e0e20b404504adc5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56f53961-7f04-5e27-af0e-1c82ddbc1cc7/56f53961-7f04-5e27-af0e-1c82ddbc1cc7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3574892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/b5/b8b589fa2ee401474ad8a0a9eb887bf2/pa/KG93945_e38b8241419ae522c99fab61b044d700.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Saving data for KG93945: {'created_time': 1774730003.121148, 'last_price_update_time': 1774730003.12116, 'auction_closing_time': 1774885911.0}
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG93945') HTTP/1.1" 204 0
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e49577885280420566a8034e89299644.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_b15f02e21c1057f12cb61510aa9c7fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_b15f02e21c1057f12cb61510aa9c7fe0.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_e51aaeb25d336cf81b172f99d621509d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e51aaeb25d336cf81b172f99d621509d.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_5294df7f1d8cac7c5f5af7b3e3737a3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_5294df7f1d8cac7c5f5af7b3e3737a3a.jpg not downloaded yet
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ00131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM21252> (referer: https://www.auto1.com/v1/car-details-view/CM21252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER36240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720dec50>
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_c658b28b8a149eece0e1f0c5982eefbb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_c658b28b8a149eece0e1f0c5982eefbb.jpg saved to cache
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_1862bd5249e2a0be4c0f0ff26f893759.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_1862bd5249e2a0be4c0f0ff26f893759.jpg not downloaded yet
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU29077> (referer: https://www.auto1.com/v1/car-details-view/AU29077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173017150>
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_44e21d18f28e946c9f1d4977880774fd.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_44e21d18f28e946c9f1d4977880774fd.jpg saved to cache
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_346dbade41690a1d7c9f941978e483a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_346dbade41690a1d7c9f941978e483a7.jpg not downloaded yet
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a15a67e3966e9c13464f583486b426d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_692074a833053355ab39300d0cf0f46b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_692074a833053355ab39300d0cf0f46b.jpg not downloaded yet
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179414190>
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_e49577885280420566a8034e89299644.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e49577885280420566a8034e89299644.jpg saved to cache
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_7cc3e7aeee2b59f1f419ceaa44616734.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_7cc3e7aeee2b59f1f419ceaa44616734.jpg not downloaded yet
2026-03-28 20:33:23 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1094 | hits on page: 40
2026-03-28 20:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252
2026-03-28 20:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7383b066-8091-522a-b80c-88c0ec5112cb with scrape type 1
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_2baabe0aa417a589a7f51b38f2a7a46d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2baabe0aa417a589a7f51b38f2a7a46d.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_36a8ec68a8a4f7c79d17cf35cef8bd0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_36a8ec68a8a4f7c79d17cf35cef8bd0f.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_2c241e289e9d7bb8a5b3b00d72bbc390.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_2c241e289e9d7bb8a5b3b00d72bbc390.jpg not downloaded yet
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: VK18525
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for HR69689: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for FC15884: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for KX73156: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for CA73486: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for NU74968: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for WX14373: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for SW60531: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for KH65741: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for JJ51820: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for CV58665: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for NE94103: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for RC51689: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for KB41449: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for JU94491: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [auto1.be] INFO: Scrape type for PU93740: 0
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-28 20:33:23 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_8b3d41cea738e20ef8ea21e2cdb7549b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8b3d41cea738e20ef8ea21e2cdb7549b.jpg not downloaded yet
2026-03-28 20:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077
2026-03-28 20:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eccc3b65-2f9f-5779-87cd-ba73ac479b15 with scrape type 1
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_5ee28b11439bb256d6f502cf7d9c2dbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_5ee28b11439bb256d6f502cf7d9c2dbd.jpg not downloaded yet
2026-03-28 20:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_855d7c95eba3eee955a4413cd6a52fca.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_5ed6571206abcb294d00762873a24c77.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_5ed6571206abcb294d00762873a24c77.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_a378d37f5f2babe215a12cec8fbf014c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_a378d37f5f2babe215a12cec8fbf014c.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg not downloaded yet
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_1a0c3a962cca81584a000011c83db027.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_1a0c3a962cca81584a000011c83db027.jpg not downloaded yet
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1794298d0>
2026-03-28 20:33:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_a15a67e3966e9c13464f583486b426d3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a15a67e3966e9c13464f583486b426d3.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_b15f02e21c1057f12cb61510aa9c7fe0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_a8367b23be0b7cfcca8697a2650bb305.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a8367b23be0b7cfcca8697a2650bb305.jpg not downloaded yet
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT35610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_2c374a82750aca8a0545ba3cdc7ec8d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2c374a82750aca8a0545ba3cdc7ec8d1.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_b950c94bf858447d57ea5f950dda5973.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_b950c94bf858447d57ea5f950dda5973.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_9c9cabe60b086c7388befc18d075ee88.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_9c9cabe60b086c7388befc18d075ee88.jpg not downloaded yet
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17313d3d0>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_855d7c95eba3eee955a4413cd6a52fca.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_855d7c95eba3eee955a4413cd6a52fca.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_29a14263c72fa893a5ffd93a155266fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_89b5499719f719d11b760ab3bfc29a17.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_7e43cbe8fc572f60fa40bc7a5b9cf9b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_7e43cbe8fc572f60fa40bc7a5b9cf9b5.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_c61121642d422494fad418aa2765ddbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_c61121642d422494fad418aa2765ddbe.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_2d60c0d162428edf49863d5790a25435.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_2d60c0d162428edf49863d5790a25435.jpg not downloaded yet
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_78103d5e7b555cb793a92ab8179704bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_d8e6043e78a8ecb196bacd9d068c2f17.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_d8e6043e78a8ecb196bacd9d068c2f17.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_27f6e1fcbd220d88235222d52485739b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_27f6e1fcbd220d88235222d52485739b.jpg not downloaded yet
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172571f10>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_b15f02e21c1057f12cb61510aa9c7fe0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_b15f02e21c1057f12cb61510aa9c7fe0.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4776c20da0b966daa1a30c03d15bc203.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e8b0d74bb007bc12d07506aad6bce6fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_f42ffcd6821ad178ee401d48fae8cf2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f42ffcd6821ad178ee401d48fae8cf2e.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_da30d22a35ebcf0270092ad60828bf46.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_da30d22a35ebcf0270092ad60828bf46.jpg not downloaded yet
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_8d57003bf6256172596ed370be509204.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_dc74ffe44d44e3174ba5dfaf649fe572.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_ff24d49585b145d60e0d837e12fd98b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_ff24d49585b145d60e0d837e12fd98b9.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_dc0e3e37bde8ce0a8d2b44f82fb69058.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_dc0e3e37bde8ce0a8d2b44f82fb69058.jpg not downloaded yet
2026-03-28 20:33:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17305b110>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_29a14263c72fa893a5ffd93a155266fe.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_29a14263c72fa893a5ffd93a155266fe.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172644e90>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_89b5499719f719d11b760ab3bfc29a17.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_89b5499719f719d11b760ab3bfc29a17.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173015950>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_78103d5e7b555cb793a92ab8179704bb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_78103d5e7b555cb793a92ab8179704bb.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_f85e12a8d991f08deae549a4e1d06fc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f85e12a8d991f08deae549a4e1d06fc8.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_450d09722d00ef95eae74c4da83aeff2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_450d09722d00ef95eae74c4da83aeff2.jpg not downloaded yet
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_5ed6571206abcb294d00762873a24c77.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_5ee28b11439bb256d6f502cf7d9c2dbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_1862bd5249e2a0be4c0f0ff26f893759.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_8358de339564d8a3b96b5b70f7cc1343.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8358de339564d8a3b96b5b70f7cc1343.jpg not downloaded yet
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_03d795e741afc9a71f92264f131c3ac9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_03d795e741afc9a71f92264f131c3ac9.jpg not downloaded yet
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b4e50>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_4776c20da0b966daa1a30c03d15bc203.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4776c20da0b966daa1a30c03d15bc203.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732e6bd0>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_e8b0d74bb007bc12d07506aad6bce6fb.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e8b0d74bb007bc12d07506aad6bce6fb.jpg saved to cache
2026-03-28 20:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173037550>
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_8d57003bf6256172596ed370be509204.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_8d57003bf6256172596ed370be509204.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fcb710>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_dc74ffe44d44e3174ba5dfaf649fe572.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_dc74ffe44d44e3174ba5dfaf649fe572.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_f71633b61b34caf507a2cb77290495b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_f71633b61b34caf507a2cb77290495b9.jpg not downloaded yet
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a8367b23be0b7cfcca8697a2650bb305.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fc8e50>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_5ed6571206abcb294d00762873a24c77.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_5ed6571206abcb294d00762873a24c77.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730f6650>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_5ee28b11439bb256d6f502cf7d9c2dbd.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_5ee28b11439bb256d6f502cf7d9c2dbd.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731ec710>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_1862bd5249e2a0be4c0f0ff26f893759.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_1862bd5249e2a0be4c0f0ff26f893759.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH80996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725122d0>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_a8367b23be0b7cfcca8697a2650bb305.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a8367b23be0b7cfcca8697a2650bb305.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8358de339564d8a3b96b5b70f7cc1343.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_450d09722d00ef95eae74c4da83aeff2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_f71633b61b34caf507a2cb77290495b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_03d795e741afc9a71f92264f131c3ac9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_b979a4a70539bcb6f1e7091cffa2dc5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4664c46238d546b689881637c760469d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_5294df7f1d8cac7c5f5af7b3e3737a3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_ff24d49585b145d60e0d837e12fd98b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f85e12a8d991f08deae549a4e1d06fc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_da30d22a35ebcf0270092ad60828bf46.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_c61121642d422494fad418aa2765ddbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_27f6e1fcbd220d88235222d52485739b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_2d60c0d162428edf49863d5790a25435.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720a8e50>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_8358de339564d8a3b96b5b70f7cc1343.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8358de339564d8a3b96b5b70f7cc1343.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_9c9cabe60b086c7388befc18d075ee88.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725105d0>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_450d09722d00ef95eae74c4da83aeff2.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_450d09722d00ef95eae74c4da83aeff2.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730f4550>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_f71633b61b34caf507a2cb77290495b9.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_f71633b61b34caf507a2cb77290495b9.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173031a10>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_03d795e741afc9a71f92264f131c3ac9.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_03d795e741afc9a71f92264f131c3ac9.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17315fed0>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_b979a4a70539bcb6f1e7091cffa2dc5f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_b979a4a70539bcb6f1e7091cffa2dc5f.jpg saved to cache
2026-03-28 20:33:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173033590>
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_4664c46238d546b689881637c760469d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4664c46238d546b689881637c760469d.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d7250>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_5294df7f1d8cac7c5f5af7b3e3737a3a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_5294df7f1d8cac7c5f5af7b3e3737a3a.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172131790>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_ff24d49585b145d60e0d837e12fd98b9.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_ff24d49585b145d60e0d837e12fd98b9.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17303e410>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_f85e12a8d991f08deae549a4e1d06fc8.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f85e12a8d991f08deae549a4e1d06fc8.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f42ffcd6821ad178ee401d48fae8cf2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_dc0e3e37bde8ce0a8d2b44f82fb69058.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17216ee90>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_da30d22a35ebcf0270092ad60828bf46.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_da30d22a35ebcf0270092ad60828bf46.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17215dbd0>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_c61121642d422494fad418aa2765ddbe.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_c61121642d422494fad418aa2765ddbe.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721486d0>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_27f6e1fcbd220d88235222d52485739b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_27f6e1fcbd220d88235222d52485739b.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172148e90>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_2d60c0d162428edf49863d5790a25435.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_2d60c0d162428edf49863d5790a25435.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732d7750>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_9c9cabe60b086c7388befc18d075ee88.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_9c9cabe60b086c7388befc18d075ee88.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT35610> (referer: https://www.auto1.com/v1/car-details-view/KT35610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17210f490>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_f42ffcd6821ad178ee401d48fae8cf2e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f42ffcd6821ad178ee401d48fae8cf2e.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b6510>
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_dc0e3e37bde8ce0a8d2b44f82fb69058.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_dc0e3e37bde8ce0a8d2b44f82fb69058.jpg saved to cache
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_b950c94bf858447d57ea5f950dda5973.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8b3d41cea738e20ef8ea21e2cdb7549b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_1a0c3a962cca81584a000011c83db027.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610
2026-03-28 20:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac110c0-c182-59cd-9ab0-33653e50f40c with scrape type 1
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ac110c0-c182-59cd-9ab0-33653e50f40c
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_77f035cb49a00e08cc2858794fc57ad2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_77f035cb49a00e08cc2858794fc57ad2.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_ee33bed5a83ad2518920e2ac39936593.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_ee33bed5a83ad2518920e2ac39936593.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_74403491fd1448d4aaf52ec61c0fcec6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_74403491fd1448d4aaf52ec61c0fcec6.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_83a8cf8af17f3d0cdd2e5344c4f33e75.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_83a8cf8af17f3d0cdd2e5344c4f33e75.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_d40cb33136af60a8cfbc9d45d68a1faf.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_d40cb33136af60a8cfbc9d45d68a1faf.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_5d6aed9f76e784ecfbc9d4efd18b67e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_5d6aed9f76e784ecfbc9d4efd18b67e4.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_9a9b6c002dcec1d5c481950a15f3b763.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_9a9b6c002dcec1d5c481950a15f3b763.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_e526817eed15e948a37ffbced817e0a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_e526817eed15e948a37ffbced817e0a6.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_5bd0f4a1883df2a83143c591616077a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_5bd0f4a1883df2a83143c591616077a4.jpg already downloaded
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F28%252F2d288ff9cbcc4e8fac349494c9b39ba9%252Fpa%252FKT35610_2060ebceab794a57e04507b3ffd5f3a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_2060ebceab794a57e04507b3ffd5f3a8.jpg already downloaded
2026-03-28 20:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ac110c0-c182-59cd-9ab0-33653e50f40c, identifier: KT35610
2026-03-28 20:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610
2026-03-28 20:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610
2026-03-28 20:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610 to the API
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KT35610>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'petrol',
 'id': '6ac110c0-c182-59cd-9ab0-33653e50f40c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT35610',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 143964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_77f035cb49a00e08cc2858794fc57ad2.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_ee33bed5a83ad2518920e2ac39936593.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_74403491fd1448d4aaf52ec61c0fcec6.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_83a8cf8af17f3d0cdd2e5344c4f33e75.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_d40cb33136af60a8cfbc9d45d68a1faf.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_5d6aed9f76e784ecfbc9d4efd18b67e4.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_9a9b6c002dcec1d5c481950a15f3b763.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_e526817eed15e948a37ffbced817e0a6.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_5bd0f4a1883df2a83143c591616077a4.jpg',
                'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_2060ebceab794a57e04507b3ffd5f3a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_77f035cb49a00e08cc2858794fc57ad2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_ee33bed5a83ad2518920e2ac39936593.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_74403491fd1448d4aaf52ec61c0fcec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2575456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_83a8cf8af17f3d0cdd2e5344c4f33e75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2413010,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_d40cb33136af60a8cfbc9d45d68a1faf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_5d6aed9f76e784ecfbc9d4efd18b67e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_9a9b6c002dcec1d5c481950a15f3b763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_e526817eed15e948a37ffbced817e0a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_5bd0f4a1883df2a83143c591616077a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ac110c0-c182-59cd-9ab0-33653e50f40c/6ac110c0-c182-59cd-9ab0-33653e50f40c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/28/2d288ff9cbcc4e8fac349494c9b39ba9/pa/KT35610_2060ebceab794a57e04507b3ffd5f3a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-28 20:33:27 [auto1.be] INFO: Saving data for KT35610: {'created_time': 1774730007.754609, 'last_price_update_time': 1774730007.754621, 'auction_closing_time': 1774882992.0}
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT35610') HTTP/1.1" 204 0
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_2c241e289e9d7bb8a5b3b00d72bbc390.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER36240> (referer: https://www.auto1.com/v1/car-details-view/ER36240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ00131> (referer: https://www.auto1.com/v1/car-details-view/TJ00131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH80996> (referer: https://www.auto1.com/v1/car-details-view/GH80996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2baabe0aa417a589a7f51b38f2a7a46d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_36a8ec68a8a4f7c79d17cf35cef8bd0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_7e43cbe8fc572f60fa40bc7a5b9cf9b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bff10>
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_b950c94bf858447d57ea5f950dda5973.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_b950c94bf858447d57ea5f950dda5973.jpg saved to cache
2026-03-28 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f2e850>
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_8b3d41cea738e20ef8ea21e2cdb7549b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8b3d41cea738e20ef8ea21e2cdb7549b.jpg saved to cache
2026-03-28 20:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e5fd0>
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa5%252Fafa5b2dbce4bba9a6fc6db8264d00a86%252Fpa%252FAU29077_1a0c3a962cca81584a000011c83db027.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_1a0c3a962cca81584a000011c83db027.jpg saved to cache
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eccc3b65-2f9f-5779-87cd-ba73ac479b15
2026-03-28 20:33:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eccc3b65-2f9f-5779-87cd-ba73ac479b15, skipping ID generation
2026-03-28 20:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eccc3b65-2f9f-5779-87cd-ba73ac479b15 with scrape type 1
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eccc3b65-2f9f-5779-87cd-ba73ac479b15 sending to next pipeline
2026-03-28 20:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eccc3b65-2f9f-5779-87cd-ba73ac479b15, identifier: AU29077
2026-03-28 20:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077
2026-03-28 20:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077
2026-03-28 20:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077 to the API
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_1a0c3a962cca81584a000011c83db027.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.3L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:20:19Z',
 'fuel_type': 'diesel',
 'id': 'eccc3b65-2f9f-5779-87cd-ba73ac479b15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU29077',
 'listing': 'auction',
 'location': 'BE, Retie',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 182286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_5ee28b11439bb256d6f502cf7d9c2dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_1a0c3a962cca81584a000011c83db027.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_b950c94bf858447d57ea5f950dda5973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_c61121642d422494fad418aa2765ddbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_27f6e1fcbd220d88235222d52485739b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_da30d22a35ebcf0270092ad60828bf46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_dc0e3e37bde8ce0a8d2b44f82fb69058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_450d09722d00ef95eae74c4da83aeff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_03d795e741afc9a71f92264f131c3ac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eccc3b65-2f9f-5779-87cd-ba73ac479b15/eccc3b65-2f9f-5779-87cd-ba73ac479b15_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a5/afa5b2dbce4bba9a6fc6db8264d00a86/pa/AU29077_f71633b61b34caf507a2cb77290495b9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L4H2 Multicab RS: 4035 mm',
 'transmission': 'manual',
 'trim': 'L4H2 Multicab RS: 4035 mm',
 'year': 2016}
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [auto1.be] INFO: Saving data for AU29077: {'created_time': 1774730008.483455, 'last_price_update_time': 1774730008.483467, 'auction_closing_time': 1774884019.0}
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU29077') HTTP/1.1" 204 0
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_d8e6043e78a8ecb196bacd9d068c2f17.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_7cc3e7aeee2b59f1f419ceaa44616734.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e51aaeb25d336cf81b172f99d621509d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_346dbade41690a1d7c9f941978e483a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_692074a833053355ab39300d0cf0f46b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bc090>
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_2c241e289e9d7bb8a5b3b00d72bbc390.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_2c241e289e9d7bb8a5b3b00d72bbc390.jpg saved to cache
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240
2026-03-28 20:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e56297-36bf-51e1-858e-f04b6f91a78a with scrape type 1
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_bd05093ef88cc2897d479fc9fec8455a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd05093ef88cc2897d479fc9fec8455a.jpg not downloaded yet
2026-03-28 20:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131
2026-03-28 20:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebd68b4-c645-56b5-976c-7e64ee243417 with scrape type 1
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_99e6dcba3b08899a97eca6129384474c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_99e6dcba3b08899a97eca6129384474c.jpg not downloaded yet
2026-03-28 20:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996
2026-03-28 20:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3447f573-ccfe-5136-88ae-151c39cb24e8 with scrape type 1
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_5201056f38db5609e761d33555cfc63e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_5201056f38db5609e761d33555cfc63e.jpg not downloaded yet
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730de7d0>
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_2baabe0aa417a589a7f51b38f2a7a46d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2baabe0aa417a589a7f51b38f2a7a46d.jpg saved to cache
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790dfb90>
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_36a8ec68a8a4f7c79d17cf35cef8bd0f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_36a8ec68a8a4f7c79d17cf35cef8bd0f.jpg saved to cache
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173f5a510>
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_7e43cbe8fc572f60fa40bc7a5b9cf9b5.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_7e43cbe8fc572f60fa40bc7a5b9cf9b5.jpg saved to cache
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_801621dcab5c9867e3e9f14a0fc10610.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_801621dcab5c9867e3e9f14a0fc10610.jpg not downloaded yet
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_be1db47a63fc12bae888b36a8e9ef3e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_be1db47a63fc12bae888b36a8e9ef3e1.jpg not downloaded yet
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_e483bf2bc45088687ba28b79ffe4fd86.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_e483bf2bc45088687ba28b79ffe4fd86.jpg not downloaded yet
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a015d08b71cafefc923b855c8f9c038b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_3c22321a515512295e1c74afb39156da.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_3283b8898ffe0e67df4b4bbf09080411.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_3283b8898ffe0e67df4b4bbf09080411.jpg not downloaded yet
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_4a0b2470ca40fe045813b284d18b7522.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_4a0b2470ca40fe045813b284d18b7522.jpg not downloaded yet
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_a0d951cd029f689d43ec35b01466cc63.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_a0d951cd029f689d43ec35b01466cc63.jpg not downloaded yet
2026-03-28 20:33:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a6310>
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_d8e6043e78a8ecb196bacd9d068c2f17.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_d8e6043e78a8ecb196bacd9d068c2f17.jpg saved to cache
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17310a910>
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_7cc3e7aeee2b59f1f419ceaa44616734.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_7cc3e7aeee2b59f1f419ceaa44616734.jpg saved to cache
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172659e50>
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_e51aaeb25d336cf81b172f99d621509d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e51aaeb25d336cf81b172f99d621509d.jpg saved to cache
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c4690>
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_346dbade41690a1d7c9f941978e483a7.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_346dbade41690a1d7c9f941978e483a7.jpg saved to cache
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173109b10>
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F09%252F9909c3028d0197dd473180e08fea97a5%252Fpa%252FBT92464_692074a833053355ab39300d0cf0f46b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_692074a833053355ab39300d0cf0f46b.jpg saved to cache
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56c54f33-0575-5e02-a335-a810a3592be1
2026-03-28 20:33:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56c54f33-0575-5e02-a335-a810a3592be1, skipping ID generation
2026-03-28 20:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c54f33-0575-5e02-a335-a810a3592be1 with scrape type 1
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56c54f33-0575-5e02-a335-a810a3592be1 sending to next pipeline
2026-03-28 20:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56c54f33-0575-5e02-a335-a810a3592be1, identifier: BT92464
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_647982c76aea5cd2856bc52bd72e5e8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464
2026-03-28 20:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464
2026-03-28 20:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464 to the API
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_692074a833053355ab39300d0cf0f46b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:09Z',
 'fuel_type': 'diesel',
 'id': '56c54f33-0575-5e02-a335-a810a3592be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT92464',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 157809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 21,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a15a67e3966e9c13464f583486b426d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_855d7c95eba3eee955a4413cd6a52fca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_b15f02e21c1057f12cb61510aa9c7fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_1862bd5249e2a0be4c0f0ff26f893759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_692074a833053355ab39300d0cf0f46b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_36a8ec68a8a4f7c79d17cf35cef8bd0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_5ed6571206abcb294d00762873a24c77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_a8367b23be0b7cfcca8697a2650bb305.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_9c9cabe60b086c7388befc18d075ee88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56c54f33-0575-5e02-a335-a810a3592be1/56c54f33-0575-5e02-a335-a810a3592be1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/09/9909c3028d0197dd473180e08fea97a5/pa/BT92464_2d60c0d162428edf49863d5790a25435.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-28 20:33:29 [auto1.be] INFO: Saving data for BT92464: {'created_time': 1774730009.801468, 'last_price_update_time': 1774730009.801479, 'auction_closing_time': 1774885689.0}
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT92464') HTTP/1.1" 204 0
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_bd3041c05f1efb2dc416bd55132598fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd3041c05f1efb2dc416bd55132598fe.jpg not downloaded yet
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_97a89de5dbad799b9ea7ecca14084cef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_97a89de5dbad799b9ea7ecca14084cef.jpg not downloaded yet
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_c078729039b2cf054b4c01c873527c39.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_c078729039b2cf054b4c01c873527c39.jpg not downloaded yet
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_ab3262f79d1733a55905f317affc9b41.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a993a28f0534b2a15938e70730337600.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX01518/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL95031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_5201056f38db5609e761d33555cfc63e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_634d0fb23a325600b90b9f3a73c460b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_634d0fb23a325600b90b9f3a73c460b4.jpg not downloaded yet
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_0fec8ce97ec39a6dcf16fd00b5898936.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_0fec8ce97ec39a6dcf16fd00b5898936.jpg not downloaded yet
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_ddb2c0ac05cba73bbad32ae7b8a017a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_ddb2c0ac05cba73bbad32ae7b8a017a4.jpg not downloaded yet
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173197150>
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_a015d08b71cafefc923b855c8f9c038b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a015d08b71cafefc923b855c8f9c038b.jpg saved to cache
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f92fd0>
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_3c22321a515512295e1c74afb39156da.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_3c22321a515512295e1c74afb39156da.jpg saved to cache
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:30 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1094 | hits on page: 40
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308d510>
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_647982c76aea5cd2856bc52bd72e5e8b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_647982c76aea5cd2856bc52bd72e5e8b.jpg saved to cache
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172695210>
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F08%252F3308793f30e49af0f1991b7cb986110f%252Fpa%252FUY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg saved to cache
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 419d2c8c-fda5-5957-a21d-11003767f16f
2026-03-28 20:33:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 419d2c8c-fda5-5957-a21d-11003767f16f, skipping ID generation
2026-03-28 20:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419d2c8c-fda5-5957-a21d-11003767f16f with scrape type 1
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 419d2c8c-fda5-5957-a21d-11003767f16f sending to next pipeline
2026-03-28 20:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 419d2c8c-fda5-5957-a21d-11003767f16f, identifier: UY27001
2026-03-28 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_99e6dcba3b08899a97eca6129384474c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_e483bf2bc45088687ba28b79ffe4fd86.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_d65b33c5175e74c62d3a9276946fffd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_d65b33c5175e74c62d3a9276946fffd2.jpg not downloaded yet
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg not downloaded yet
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_4e5a3f235e7959951f92e0428810983a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_4e5a3f235e7959951f92e0428810983a.jpg not downloaded yet
2026-03-28 20:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001
2026-03-28 20:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001
2026-03-28 20:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001 to the API
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:38:57Z',
 'fuel_type': 'diesel',
 'id': '419d2c8c-fda5-5957-a21d-11003767f16f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY27001',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 183729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_647982c76aea5cd2856bc52bd72e5e8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e49577885280420566a8034e89299644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_3d6fa98ace66cefbcd5212fdd5d6691c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e8b0d74bb007bc12d07506aad6bce6fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_78103d5e7b555cb793a92ab8179704bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_419d2c8c-fda5-5957-a21d-11003767f16f/419d2c8c-fda5-5957-a21d-11003767f16f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/08/3308793f30e49af0f1991b7cb986110f/pa/UY27001_e51aaeb25d336cf81b172f99d621509d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Saving data for UY27001: {'created_time': 1774730010.73712, 'last_price_update_time': 1774730010.737133, 'auction_closing_time': 1774885137.0}
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY27001') HTTP/1.1" 204 0
2026-03-28 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_4a0b2470ca40fe045813b284d18b7522.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_a0d951cd029f689d43ec35b01466cc63.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for GV92885: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for DV83163: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for AF15006: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for JY19882: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for JZ80953: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for TL44110: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for FC31614: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for CU06988: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for KH04328: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: MB27937
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for GN32494: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-28 20:33:30 [auto1.be] INFO: Scrape type for LA84805: 0
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-28 20:33:30 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for RX31058: 0
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for BB55914: 0
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for KC67497: 0
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: US61346
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for US61346: 0
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for SY12350: 0
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for ST29091: 0
2026-03-28 20:33:31 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-28 20:33:31 [auto1.be] INFO: Scrape type for TV57254: 0
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17315d850>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_ab3262f79d1733a55905f317affc9b41.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_ab3262f79d1733a55905f317affc9b41.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732e7410>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_a993a28f0534b2a15938e70730337600.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a993a28f0534b2a15938e70730337600.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1794129d0>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_5201056f38db5609e761d33555cfc63e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_5201056f38db5609e761d33555cfc63e.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_3283b8898ffe0e67df4b4bbf09080411.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT55223/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_be1db47a63fc12bae888b36a8e9ef3e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_c078729039b2cf054b4c01c873527c39.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726239d0>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_99e6dcba3b08899a97eca6129384474c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_99e6dcba3b08899a97eca6129384474c.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17328cad0>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_e483bf2bc45088687ba28b79ffe4fd86.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_e483bf2bc45088687ba28b79ffe4fd86.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172124550>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_4a0b2470ca40fe045813b284d18b7522.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_4a0b2470ca40fe045813b284d18b7522.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f22a90>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_a0d951cd029f689d43ec35b01466cc63.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_a0d951cd029f689d43ec35b01466cc63.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2c374a82750aca8a0545ba3cdc7ec8d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_ddb2c0ac05cba73bbad32ae7b8a017a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_97a89de5dbad799b9ea7ecca14084cef.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd3041c05f1efb2dc416bd55132598fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17256ccd0>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_3283b8898ffe0e67df4b4bbf09080411.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_3283b8898ffe0e67df4b4bbf09080411.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172147410>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_be1db47a63fc12bae888b36a8e9ef3e1.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_be1db47a63fc12bae888b36a8e9ef3e1.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726b49d0>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_c078729039b2cf054b4c01c873527c39.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_c078729039b2cf054b4c01c873527c39.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_0fec8ce97ec39a6dcf16fd00b5898936.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_4e5a3f235e7959951f92e0428810983a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1720dfd10>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_2c374a82750aca8a0545ba3cdc7ec8d1.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2c374a82750aca8a0545ba3cdc7ec8d1.jpg saved to cache
2026-03-28 20:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172162d10>
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_ddb2c0ac05cba73bbad32ae7b8a017a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_ddb2c0ac05cba73bbad32ae7b8a017a4.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732690d0>
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_97a89de5dbad799b9ea7ecca14084cef.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_97a89de5dbad799b9ea7ecca14084cef.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172505f90>
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_bd3041c05f1efb2dc416bd55132598fe.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd3041c05f1efb2dc416bd55132598fe.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD86163> (referer: https://www.auto1.com/v1/car-details-view/SD86163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd05093ef88cc2897d479fc9fec8455a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_801621dcab5c9867e3e9f14a0fc10610.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_634d0fb23a325600b90b9f3a73c460b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_d65b33c5175e74c62d3a9276946fffd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726d8e50>
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fb1%252F6bb15c86c47ba9cb41a2355982e2daea%252Fpa%252FCM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7383b066-8091-522a-b80c-88c0ec5112cb
2026-03-28 20:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7383b066-8091-522a-b80c-88c0ec5112cb, skipping ID generation
2026-03-28 20:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7383b066-8091-522a-b80c-88c0ec5112cb with scrape type 1
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7383b066-8091-522a-b80c-88c0ec5112cb sending to next pipeline
2026-03-28 20:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7383b066-8091-522a-b80c-88c0ec5112cb, identifier: CM21252
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172513610>
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_0fec8ce97ec39a6dcf16fd00b5898936.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_0fec8ce97ec39a6dcf16fd00b5898936.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f22190>
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F67%252F8567c3ead6d6433c3b031bfb1624eca6%252Fpa%252FTJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eebd68b4-c645-56b5-976c-7e64ee243417
2026-03-28 20:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eebd68b4-c645-56b5-976c-7e64ee243417, skipping ID generation
2026-03-28 20:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebd68b4-c645-56b5-976c-7e64ee243417 with scrape type 1
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eebd68b4-c645-56b5-976c-7e64ee243417 sending to next pipeline
2026-03-28 20:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eebd68b4-c645-56b5-976c-7e64ee243417, identifier: TJ00131
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c5610>
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fad%252F11ad47b6ffad6b23f58794ee5a105c23%252Fpa%252FGH80996_4e5a3f235e7959951f92e0428810983a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_4e5a3f235e7959951f92e0428810983a.jpg saved to cache
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3447f573-ccfe-5136-88ae-151c39cb24e8
2026-03-28 20:33:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3447f573-ccfe-5136-88ae-151c39cb24e8, skipping ID generation
2026-03-28 20:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3447f573-ccfe-5136-88ae-151c39cb24e8 with scrape type 1
2026-03-28 20:33:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3447f573-ccfe-5136-88ae-151c39cb24e8 sending to next pipeline
2026-03-28 20:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3447f573-ccfe-5136-88ae-151c39cb24e8, identifier: GH80996
2026-03-28 20:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252
2026-03-28 20:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252
2026-03-28 20:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252 to the API
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:21Z',
 'fuel_type': 'diesel',
 'id': '7383b066-8091-522a-b80c-88c0ec5112cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM21252',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 150893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2baabe0aa417a589a7f51b38f2a7a46d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8b3d41cea738e20ef8ea21e2cdb7549b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1968183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_9e7c6ee87ce2be3c55b270a9ca8a7cb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1829933,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_2c374a82750aca8a0545ba3cdc7ec8d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1879937,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_7e43cbe8fc572f60fa40bc7a5b9cf9b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1829536,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_d8e6043e78a8ecb196bacd9d068c2f17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1778737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f42ffcd6821ad178ee401d48fae8cf2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_ff24d49585b145d60e0d837e12fd98b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_f85e12a8d991f08deae549a4e1d06fc8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7383b066-8091-522a-b80c-88c0ec5112cb/7383b066-8091-522a-b80c-88c0ec5112cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/b1/6bb15c86c47ba9cb41a2355982e2daea/pa/CM21252_8358de339564d8a3b96b5b70f7cc1343.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Venga 1.6 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-28 20:33:33 [auto1.be] INFO: Saving data for CM21252: {'created_time': 1774730013.054301, 'last_price_update_time': 1774730013.054314, 'auction_closing_time': 1774884261.0}
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM21252') HTTP/1.1" 204 0
2026-03-28 20:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131
2026-03-28 20:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131
2026-03-28 20:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131 to the API
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'petrol',
 'id': 'eebd68b4-c645-56b5-976c-7e64ee243417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ00131',
 'listing': 'auction',
 'location': 'BE, Wommelgem',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 154578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_99e6dcba3b08899a97eca6129384474c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_be1db47a63fc12bae888b36a8e9ef3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_4a0b2470ca40fe045813b284d18b7522.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_97a89de5dbad799b9ea7ecca14084cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_0fec8ce97ec39a6dcf16fd00b5898936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eebd68b4-c645-56b5-976c-7e64ee243417/eebd68b4-c645-56b5-976c-7e64ee243417_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/67/8567c3ead6d6433c3b031bfb1624eca6/pa/TJ00131_70cd3749bb0a1f3f2f5f52cd860a3733.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar S-TYPE 3.0 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-28 20:33:33 [auto1.be] INFO: Saving data for TJ00131: {'created_time': 1774730013.542483, 'last_price_update_time': 1774730013.542494, 'auction_closing_time': 1774884421.0}
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TJ00131') HTTP/1.1" 204 0
2026-03-28 20:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996
2026-03-28 20:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996
2026-03-28 20:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996 to the API
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_4e5a3f235e7959951f92e0428810983a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'petrol',
 'id': '3447f573-ccfe-5136-88ae-151c39cb24e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH80996',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 210882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_5201056f38db5609e761d33555cfc63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_e483bf2bc45088687ba28b79ffe4fd86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_a0d951cd029f689d43ec35b01466cc63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_c078729039b2cf054b4c01c873527c39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_ddb2c0ac05cba73bbad32ae7b8a017a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3447f573-ccfe-5136-88ae-151c39cb24e8/3447f573-ccfe-5136-88ae-151c39cb24e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/ad/11ad47b6ffad6b23f58794ee5a105c23/pa/GH80996_4e5a3f235e7959951f92e0428810983a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-28 20:33:33 [auto1.be] INFO: Saving data for GH80996: {'created_time': 1774730013.918888, 'last_price_update_time': 1774730013.918898, 'auction_closing_time': 1774882978.0}
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH80996') HTTP/1.1" 204 0
2026-03-28 20:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_255b40792ff565b5805f5b7ef2895bd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_5ad081153fcf960be6aaa3c9e071c396.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL05782> (referer: https://www.auto1.com/v1/car-details-view/FL05782/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX01518> (referer: https://www.auto1.com/v1/car-details-view/UX01518/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163
2026-03-28 20:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e448bc6e-2d4c-5467-a005-de3ea2bc8299 with scrape type 1
2026-03-28 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_810b22239f18f0063db5d8be1af47719.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_810b22239f18f0063db5d8be1af47719.jpg not downloaded yet
2026-03-28 20:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fe3cd0>
2026-03-28 20:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_bd05093ef88cc2897d479fc9fec8455a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd05093ef88cc2897d479fc9fec8455a.jpg saved to cache
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172529490>
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_801621dcab5c9867e3e9f14a0fc10610.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_801621dcab5c9867e3e9f14a0fc10610.jpg saved to cache
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732be2d0>
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_634d0fb23a325600b90b9f3a73c460b4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_634d0fb23a325600b90b9f3a73c460b4.jpg saved to cache
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730e5290>
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Fcb%252F7dcbb9358d95f8572dcaba185b4b563b%252Fpa%252FER36240_d65b33c5175e74c62d3a9276946fffd2.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_d65b33c5175e74c62d3a9276946fffd2.jpg saved to cache
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96e56297-36bf-51e1-858e-f04b6f91a78a
2026-03-28 20:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96e56297-36bf-51e1-858e-f04b6f91a78a, skipping ID generation
2026-03-28 20:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e56297-36bf-51e1-858e-f04b6f91a78a with scrape type 1
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96e56297-36bf-51e1-858e-f04b6f91a78a sending to next pipeline
2026-03-28 20:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96e56297-36bf-51e1-858e-f04b6f91a78a, identifier: ER36240
2026-03-28 20:33:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL95031> (referer: https://www.auto1.com/v1/car-details-view/EL95031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240
2026-03-28 20:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240
2026-03-28 20:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240 to the API
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_d65b33c5175e74c62d3a9276946fffd2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:06Z',
 'fuel_type': 'diesel',
 'id': '96e56297-36bf-51e1-858e-f04b6f91a78a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER36240',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 211710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd05093ef88cc2897d479fc9fec8455a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_801621dcab5c9867e3e9f14a0fc10610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_3283b8898ffe0e67df4b4bbf09080411.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_bd3041c05f1efb2dc416bd55132598fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_634d0fb23a325600b90b9f3a73c460b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e56297-36bf-51e1-858e-f04b6f91a78a/96e56297-36bf-51e1-858e-f04b6f91a78a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/cb/7dcbb9358d95f8572dcaba185b4b563b/pa/ER36240_d65b33c5175e74c62d3a9276946fffd2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [auto1.be] INFO: Saving data for ER36240: {'created_time': 1774730014.616442, 'last_price_update_time': 1774730014.616455, 'auction_closing_time': 1774883166.0}
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER36240') HTTP/1.1" 204 0
2026-03-28 20:33:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_a378d37f5f2babe215a12cec8fbf014c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_5b2d6027daf47442c83d1b846aabc608.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_85dd53861964d19f3f33c325864dc4ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_85dd53861964d19f3f33c325864dc4ff.jpg not downloaded yet
2026-03-28 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ74713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fef850>
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_255b40792ff565b5805f5b7ef2895bd4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_255b40792ff565b5805f5b7ef2895bd4.jpg saved to cache
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a7110>
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_5ad081153fcf960be6aaa3c9e071c396.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_5ad081153fcf960be6aaa3c9e071c396.jpg saved to cache
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782
2026-03-28 20:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc453bd1-9879-51e2-ab27-77802f466239 with scrape type 1
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc453bd1-9879-51e2-ab27-77802f466239
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_2f43a3ac651e47f3146e1a22e92dbbad.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_2f43a3ac651e47f3146e1a22e92dbbad.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_e8f61a3ef34454aeef27fff459074214.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_e8f61a3ef34454aeef27fff459074214.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_84b5fe9505d42a1457979015dec787b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_84b5fe9505d42a1457979015dec787b5.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_b79f218ad665070d93a079250fc4038b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_b79f218ad665070d93a079250fc4038b.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_f5e98ee9da8ae7e15ad4c0c268e7009c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_f5e98ee9da8ae7e15ad4c0c268e7009c.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_75b75089940bf5398c4917184bce6d88.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_75b75089940bf5398c4917184bce6d88.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_8b7205050cb99bc30eb665dbd89e8a20.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_8b7205050cb99bc30eb665dbd89e8a20.jpg already downloaded
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_c9ced94b06e9ae6147e6edd0a70d7d7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_c9ced94b06e9ae6147e6edd0a70d7d7a.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_13400904b576e3519e2d5546d1ed4198.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_13400904b576e3519e2d5546d1ed4198.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F64%252Fdb64bed918aaca8a4a2670c25f757ca3%252Fpa%252FFL05782_bc6ace8c4ae483f5d8d22b7c8ad3de29.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_bc6ace8c4ae483f5d8d22b7c8ad3de29.jpg already downloaded
2026-03-28 20:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc453bd1-9879-51e2-ab27-77802f466239, identifier: FL05782
2026-03-28 20:33:35 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1094 | hits on page: 40
2026-03-28 20:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518
2026-03-28 20:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f with scrape type 1
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_4a05aa3d97b6b253b2ad267b837b9be6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_4a05aa3d97b6b253b2ad267b837b9be6.jpg not downloaded yet
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_1afcddd2d73bda691f5cb8fc1af4311d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_1afcddd2d73bda691f5cb8fc1af4311d.jpg not downloaded yet
2026-03-28 20:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782
2026-03-28 20:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782
2026-03-28 20:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782 to the API
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL05782>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:55:33Z',
 'fuel_type': 'hybrid',
 'id': 'dc453bd1-9879-51e2-ab27-77802f466239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL05782',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 168374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_2f43a3ac651e47f3146e1a22e92dbbad.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_e8f61a3ef34454aeef27fff459074214.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_84b5fe9505d42a1457979015dec787b5.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_b79f218ad665070d93a079250fc4038b.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_f5e98ee9da8ae7e15ad4c0c268e7009c.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_75b75089940bf5398c4917184bce6d88.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_8b7205050cb99bc30eb665dbd89e8a20.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_c9ced94b06e9ae6147e6edd0a70d7d7a.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_13400904b576e3519e2d5546d1ed4198.jpg',
                'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_bc6ace8c4ae483f5d8d22b7c8ad3de29.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047100,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_2f43a3ac651e47f3146e1a22e92dbbad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_e8f61a3ef34454aeef27fff459074214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3058177,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_84b5fe9505d42a1457979015dec787b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_b79f218ad665070d93a079250fc4038b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_f5e98ee9da8ae7e15ad4c0c268e7009c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_75b75089940bf5398c4917184bce6d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_8b7205050cb99bc30eb665dbd89e8a20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3409518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_c9ced94b06e9ae6147e6edd0a70d7d7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3251968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_13400904b576e3519e2d5546d1ed4198.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc453bd1-9879-51e2-ab27-77802f466239/dc453bd1-9879-51e2-ab27-77802f466239_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3220452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/64/db64bed918aaca8a4a2670c25f757ca3/pa/FL05782_bc6ace8c4ae483f5d8d22b7c8ad3de29.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2015}
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Saving data for FL05782: {'created_time': 1774730015.553368, 'last_price_update_time': 1774730015.553379, 'auction_closing_time': 1774886133.0}
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL05782') HTTP/1.1" 204 0
2026-03-28 20:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_34bb88201f36d9434463a477c3bf3fba.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for RF01360: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for UU14069: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for XG78459: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for RC25321: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for YZ86935: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for XB72565: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for PV46198: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for XX22473: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for YA99172: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for PD03709: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-28 20:33:35 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_fdf617f4658321bfc34f4c3a7dda444e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fdf617f4658321bfc34f4c3a7dda444e.jpg not downloaded yet
2026-03-28 20:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031
2026-03-28 20:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364aa1f0-becd-5728-a6f8-7ee4897968dc with scrape type 1
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 364aa1f0-becd-5728-a6f8-7ee4897968dc
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_7d9e31cd42372b4e686f70ec59bf2e89.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_7d9e31cd42372b4e686f70ec59bf2e89.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_dd02389953261c5b766a89bed8101ae4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_dd02389953261c5b766a89bed8101ae4.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_2b55d0cb038ff26db171dd11bcd29438.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_2b55d0cb038ff26db171dd11bcd29438.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_536999e4363455ee8e28feed89616a72.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_536999e4363455ee8e28feed89616a72.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_d7a2ef431671c010233317890ee28c56.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_d7a2ef431671c010233317890ee28c56.jpg already downloaded
2026-03-28 20:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_a840f605687ad59567d82e3c73dea5f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_a840f605687ad59567d82e3c73dea5f3.jpg already downloaded
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_c6a842f8b0f5e5dcb2750dba5125ed2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_c6a842f8b0f5e5dcb2750dba5125ed2b.jpg already downloaded
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_4e995caf25156708b34efff4ba091c18.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_4e995caf25156708b34efff4ba091c18.jpg already downloaded
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_f38261ea013595a92e48537182507b68.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_f38261ea013595a92e48537182507b68.jpg already downloaded
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F0e%252Fae0e22d1702b636eef235f3e88380ea1%252Fpa%252FEL95031_76742edcf8dca3e9f4da9f4617375c47.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_76742edcf8dca3e9f4da9f4617375c47.jpg already downloaded
2026-03-28 20:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 364aa1f0-becd-5728-a6f8-7ee4897968dc, identifier: EL95031
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_52790be6f1bd3033d94c9b51d54fb693.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_52790be6f1bd3033d94c9b51d54fb693.jpg not downloaded yet
2026-03-28 20:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY24236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT55223> (referer: https://www.auto1.com/v1/car-details-view/DT55223/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031
2026-03-28 20:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031
2026-03-28 20:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031 to the API
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL95031>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:38:00Z',
 'fuel_type': 'diesel',
 'id': '364aa1f0-becd-5728-a6f8-7ee4897968dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL95031',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 133647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_7d9e31cd42372b4e686f70ec59bf2e89.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_dd02389953261c5b766a89bed8101ae4.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_2b55d0cb038ff26db171dd11bcd29438.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_536999e4363455ee8e28feed89616a72.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_d7a2ef431671c010233317890ee28c56.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_a840f605687ad59567d82e3c73dea5f3.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_c6a842f8b0f5e5dcb2750dba5125ed2b.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_4e995caf25156708b34efff4ba091c18.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_f38261ea013595a92e48537182507b68.jpg',
                'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_76742edcf8dca3e9f4da9f4617375c47.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_7d9e31cd42372b4e686f70ec59bf2e89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_dd02389953261c5b766a89bed8101ae4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_2b55d0cb038ff26db171dd11bcd29438.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_536999e4363455ee8e28feed89616a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_d7a2ef431671c010233317890ee28c56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788939,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_a840f605687ad59567d82e3c73dea5f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_c6a842f8b0f5e5dcb2750dba5125ed2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851885,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_4e995caf25156708b34efff4ba091c18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_f38261ea013595a92e48537182507b68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_364aa1f0-becd-5728-a6f8-7ee4897968dc/364aa1f0-becd-5728-a6f8-7ee4897968dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/0e/ae0e22d1702b636eef235f3e88380ea1/pa/EL95031_76742edcf8dca3e9f4da9f4617375c47.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 2.2 CRD Limited 4x4',
 'transmission': 'manual',
 'trim': 'Limited 4x4',
 'year': 2013}
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [auto1.be] INFO: Saving data for EL95031: {'created_time': 1774730016.52216, 'last_price_update_time': 1774730016.522172, 'auction_closing_time': 1774885080.0}
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL95031') HTTP/1.1" 204 0
2026-03-28 20:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_810b22239f18f0063db5d8be1af47719.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_c88ac07cf10c055fd602c0069334db91.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_c88ac07cf10c055fd602c0069334db91.jpg not downloaded yet
2026-03-28 20:33:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172529c10>
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fce%252F42cecd4e9d6301b9263f83da86eab4cc%252Fpa%252FVM76060_a378d37f5f2babe215a12cec8fbf014c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_a378d37f5f2babe215a12cec8fbf014c.jpg saved to cache
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2
2026-03-28 20:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2, skipping ID generation
2026-03-28 20:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with scrape type 1
2026-03-28 20:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 sending to next pipeline
2026-03-28 20:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2, identifier: VM76060
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17215c090>
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_5b2d6027daf47442c83d1b846aabc608.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_5b2d6027daf47442c83d1b846aabc608.jpg saved to cache
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173055a50>
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb1%252Fdfb1e4b54cab89b2b57f2bd8970d5213%252Fpa%252FPF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg saved to cache
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738
2026-03-28 20:33:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738, skipping ID generation
2026-03-28 20:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with scrape type 1
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 sending to next pipeline
2026-03-28 20:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738, identifier: PF94112
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg not downloaded yet
2026-03-28 20:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060
2026-03-28 20:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060
2026-03-28 20:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060 to the API
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_a378d37f5f2babe215a12cec8fbf014c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:13Z',
 'fuel_type': 'diesel',
 'id': '6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM76060',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 217331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_c658b28b8a149eece0e1f0c5982eefbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_b979a4a70539bcb6f1e7091cffa2dc5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_3c22321a515512295e1c74afb39156da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858118,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4664c46238d546b689881637c760469d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_4776c20da0b966daa1a30c03d15bc203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2630158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_5294df7f1d8cac7c5f5af7b3e3737a3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_346dbade41690a1d7c9f941978e483a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_7cc3e7aeee2b59f1f419ceaa44616734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_2c241e289e9d7bb8a5b3b00d72bbc390.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2/6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/ce/42cecd4e9d6301b9263f83da86eab4cc/pa/VM76060_a378d37f5f2babe215a12cec8fbf014c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-28 20:33:37 [auto1.be] INFO: Saving data for VM76060: {'created_time': 1774730017.555454, 'last_price_update_time': 1774730017.555467, 'auction_closing_time': 1774886293.0}
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM76060') HTTP/1.1" 204 0
2026-03-28 20:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112
2026-03-28 20:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112
2026-03-28 20:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112 to the API
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'diesel',
 'id': '83b1e627-e4bb-5a4c-ad0c-e40a72da9738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF94112',
 'listing': 'auction',
 'location': 'BE, Retie',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 237312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_41d6abdf9ce8a9c31f1366aeaab59995.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_3c6fa5ab3d35bc00fdd794e9f99724fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_5ad081153fcf960be6aaa3c9e071c396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_c687635c1b256bf892ae197f899d97f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_66ce370893a676fca6d4554b7415894e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_255b40792ff565b5805f5b7ef2895bd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_ab3262f79d1733a55905f317affc9b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_44e21d18f28e946c9f1d4977880774fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a993a28f0534b2a15938e70730337600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83b1e627-e4bb-5a4c-ad0c-e40a72da9738/83b1e627-e4bb-5a4c-ad0c-e40a72da9738_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b1/dfb1e4b54cab89b2b57f2bd8970d5213/pa/PF94112_a015d08b71cafefc923b855c8f9c038b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-28 20:33:37 [auto1.be] INFO: Saving data for PF94112: {'created_time': 1774730017.923611, 'last_price_update_time': 1774730017.923621, 'auction_closing_time': 1774883765.0}
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF94112') HTTP/1.1" 204 0
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17313ee50>
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_34bb88201f36d9434463a477c3bf3fba.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_34bb88201f36d9434463a477c3bf3fba.jpg saved to cache
2026-03-28 20:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_4a05aa3d97b6b253b2ad267b837b9be6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_2a766b8bf46a974d20336bd607de5645.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_2a766b8bf46a974d20336bd607de5645.jpg not downloaded yet
2026-03-28 20:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223
2026-03-28 20:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with scrape type 1
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_048cb1158b8357a2c67d61f0bacb4e93.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_048cb1158b8357a2c67d61f0bacb4e93.jpg not downloaded yet
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_85dd53861964d19f3f33c325864dc4ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_72b213da3c303793861f15df34261dee.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_72b213da3c303793861f15df34261dee.jpg not downloaded yet
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172658e50>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_810b22239f18f0063db5d8be1af47719.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_810b22239f18f0063db5d8be1af47719.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_1afcddd2d73bda691f5cb8fc1af4311d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_fa6b2906cab38fc54c95602e81690745.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fa6b2906cab38fc54c95602e81690745.jpg not downloaded yet
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_3094a095044812dce5696239964bf75d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3094a095044812dce5696239964bf75d.jpg not downloaded yet
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ04907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG03175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fdf617f4658321bfc34f4c3a7dda444e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_cf4d474c0bc87486faf350dbed666cd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_cf4d474c0bc87486faf350dbed666cd7.jpg not downloaded yet
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_de02505fa6adb93f6ba8ed766d8afa48.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_de02505fa6adb93f6ba8ed766d8afa48.jpg not downloaded yet
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17329dc90>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_4a05aa3d97b6b253b2ad267b837b9be6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_4a05aa3d97b6b253b2ad267b837b9be6.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_52790be6f1bd3033d94c9b51d54fb693.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f01590>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_85dd53861964d19f3f33c325864dc4ff.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_85dd53861964d19f3f33c325864dc4ff.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_c88ac07cf10c055fd602c0069334db91.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_2a766b8bf46a974d20336bd607de5645.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_68003d9fa1f969faed637eadffcd9714.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_68003d9fa1f969faed637eadffcd9714.jpg not downloaded yet
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_048cb1158b8357a2c67d61f0bacb4e93.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172142f90>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_1afcddd2d73bda691f5cb8fc1af4311d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_1afcddd2d73bda691f5cb8fc1af4311d.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_7c1bff7466a91b0f8ed4555fcc1c6122.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_7c1bff7466a91b0f8ed4555fcc1c6122.jpg not downloaded yet
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172608790>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_fdf617f4658321bfc34f4c3a7dda444e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fdf617f4658321bfc34f4c3a7dda444e.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_de02505fa6adb93f6ba8ed766d8afa48.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_72b213da3c303793861f15df34261dee.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fa6b2906cab38fc54c95602e81690745.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3094a095044812dce5696239964bf75d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_c19f313e7876ad03e398245aac2bc639.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c19f313e7876ad03e398245aac2bc639.jpg not downloaded yet
2026-03-28 20:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172ff9f10>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_52790be6f1bd3033d94c9b51d54fb693.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_52790be6f1bd3033d94c9b51d54fb693.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17941f650>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_c88ac07cf10c055fd602c0069334db91.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_c88ac07cf10c055fd602c0069334db91.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173168210>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_2a766b8bf46a974d20336bd607de5645.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_2a766b8bf46a974d20336bd607de5645.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732bf290>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_048cb1158b8357a2c67d61f0bacb4e93.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_048cb1158b8357a2c67d61f0bacb4e93.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_63ccee7fb572b50a51af096eac273627.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_63ccee7fb572b50a51af096eac273627.jpg not downloaded yet
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_68003d9fa1f969faed637eadffcd9714.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_cf4d474c0bc87486faf350dbed666cd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_3db1dd4d8922f1d9b3ede2f92570d0a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3db1dd4d8922f1d9b3ede2f92570d0a4.jpg not downloaded yet
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726c7e50>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_de02505fa6adb93f6ba8ed766d8afa48.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_de02505fa6adb93f6ba8ed766d8afa48.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172143950>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_72b213da3c303793861f15df34261dee.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_72b213da3c303793861f15df34261dee.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173093210>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa5%252Fa6a5c454e212718eef389fc74590b08e%252Fpa%252FSD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg saved to cache
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e448bc6e-2d4c-5467-a005-de3ea2bc8299
2026-03-28 20:33:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e448bc6e-2d4c-5467-a005-de3ea2bc8299, skipping ID generation
2026-03-28 20:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e448bc6e-2d4c-5467-a005-de3ea2bc8299 with scrape type 1
2026-03-28 20:33:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e448bc6e-2d4c-5467-a005-de3ea2bc8299 sending to next pipeline
2026-03-28 20:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e448bc6e-2d4c-5467-a005-de3ea2bc8299, identifier: SD86163
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172685dd0>
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_fa6b2906cab38fc54c95602e81690745.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fa6b2906cab38fc54c95602e81690745.jpg saved to cache
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173082fd0>
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_3094a095044812dce5696239964bf75d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3094a095044812dce5696239964bf75d.jpg saved to cache
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_c8f8047cecffaf8315cf4446caff687b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c8f8047cecffaf8315cf4446caff687b.jpg not downloaded yet
2026-03-28 20:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163
2026-03-28 20:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163
2026-03-28 20:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163 to the API
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:32Z',
 'fuel_type': 'petrol',
 'id': 'e448bc6e-2d4c-5467-a005-de3ea2bc8299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD86163',
 'listing': 'auction',
 'location': 'BE, Bornem',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 200713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_810b22239f18f0063db5d8be1af47719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_85dd53861964d19f3f33c325864dc4ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_1afcddd2d73bda691f5cb8fc1af4311d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_52790be6f1bd3033d94c9b51d54fb693.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_86d9ce57dad7eb06d3cbfa1f4547fd0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e448bc6e-2d4c-5467-a005-de3ea2bc8299/e448bc6e-2d4c-5467-a005-de3ea2bc8299_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a5/a6a5c454e212718eef389fc74590b08e/pa/SD86163_72b213da3c303793861f15df34261dee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-28 20:33:39 [auto1.be] INFO: Saving data for SD86163: {'created_time': 1774730019.47104, 'last_price_update_time': 1774730019.471052, 'auction_closing_time': 1774883612.0}
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD86163') HTTP/1.1" 204 0
2026-03-28 20:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_7c1bff7466a91b0f8ed4555fcc1c6122.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c19f313e7876ad03e398245aac2bc639.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_63ccee7fb572b50a51af096eac273627.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg not downloaded yet
2026-03-28 20:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY36246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ74713> (referer: https://www.auto1.com/v1/car-details-view/ZZ74713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172654a90>
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_68003d9fa1f969faed637eadffcd9714.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_68003d9fa1f969faed637eadffcd9714.jpg saved to cache
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790df1d0>
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F88%252F0c888f19c89a7cd74a7df66f3beb34f1%252Fpa%252FUX01518_cf4d474c0bc87486faf350dbed666cd7.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_cf4d474c0bc87486faf350dbed666cd7.jpg saved to cache
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f
2026-03-28 20:33:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2c64f7f-f2f5-5aef-aab7-03383cfa977f, skipping ID generation
2026-03-28 20:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f with scrape type 1
2026-03-28 20:33:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f sending to next pipeline
2026-03-28 20:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2c64f7f-f2f5-5aef-aab7-03383cfa977f, identifier: UX01518
2026-03-28 20:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518
2026-03-28 20:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518
2026-03-28 20:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518 to the API
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_cf4d474c0bc87486faf350dbed666cd7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:56:32Z',
 'fuel_type': 'diesel',
 'id': 'b2c64f7f-f2f5-5aef-aab7-03383cfa977f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX01518',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 94317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_4a05aa3d97b6b253b2ad267b837b9be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fdf617f4658321bfc34f4c3a7dda444e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_c88ac07cf10c055fd602c0069334db91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_2a766b8bf46a974d20336bd607de5645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_fa6b2906cab38fc54c95602e81690745.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2c64f7f-f2f5-5aef-aab7-03383cfa977f/b2c64f7f-f2f5-5aef-aab7-03383cfa977f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/88/0c888f19c89a7cd74a7df66f3beb34f1/pa/UX01518_cf4d474c0bc87486faf350dbed666cd7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi SensoDrive Exclusive',
 'transmission': 'automatic',
 'trim': 'SensoDrive Exclusive',
 'year': 2006}
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Saving data for UX01518: {'created_time': 1774730020.110108, 'last_price_update_time': 1774730020.11012, 'auction_closing_time': 1774886192.0}
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX01518') HTTP/1.1" 204 0
2026-03-28 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY24236> (referer: https://www.auto1.com/v1/car-details-view/ZY24236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3db1dd4d8922f1d9b3ede2f92570d0a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ04907> (referer: https://www.auto1.com/v1/car-details-view/MJ04907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c8f8047cecffaf8315cf4446caff687b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172565090>
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_7c1bff7466a91b0f8ed4555fcc1c6122.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_7c1bff7466a91b0f8ed4555fcc1c6122.jpg saved to cache
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fef350>
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_c19f313e7876ad03e398245aac2bc639.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c19f313e7876ad03e398245aac2bc639.jpg saved to cache
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173091990>
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_63ccee7fb572b50a51af096eac273627.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_63ccee7fb572b50a51af096eac273627.jpg saved to cache
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713
2026-03-28 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with scrape type 1
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_35071ad88fe8ad2e351eed803d77f8a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_35071ad88fe8ad2e351eed803d77f8a3.jpg not downloaded yet
2026-03-28 20:33:40 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1094 | hits on page: 14
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_38345b16f5fe264a61d4c9c01820e784.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_38345b16f5fe264a61d4c9c01820e784.jpg not downloaded yet
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for WY04920: 0
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for SJ57770: 0
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 20:33:40 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-28 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG03175> (referer: https://www.auto1.com/v1/car-details-view/YG03175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236
2026-03-28 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with scrape type 1
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_7c182ab65375337de9749c137b2c8795.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_7c182ab65375337de9749c137b2c8795.jpg not downloaded yet
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721244d0>
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_3db1dd4d8922f1d9b3ede2f92570d0a4.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3db1dd4d8922f1d9b3ede2f92570d0a4.jpg saved to cache
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907
2026-03-28 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5cc812-8365-50da-b6f4-19fff86690e6 with scrape type 1
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_888098b927bf8e1642bb85a2841fba33.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_888098b927bf8e1642bb85a2841fba33.jpg not downloaded yet
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17252a390>
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_c8f8047cecffaf8315cf4446caff687b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c8f8047cecffaf8315cf4446caff687b.jpg saved to cache
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_89baf9f0efbabb0242e4991f68a634c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_89baf9f0efbabb0242e4991f68a634c3.jpg not downloaded yet
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_272063f3f2737357a04bc8d2f3afe8a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_272063f3f2737357a04bc8d2f3afe8a6.jpg not downloaded yet
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_b65fe87ea8ce2bfe403bc32ef55960b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b65fe87ea8ce2bfe403bc32ef55960b8.jpg not downloaded yet
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_029ace73a8060d8c42719ee15568055b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_029ace73a8060d8c42719ee15568055b.jpg not downloaded yet
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172565fd0>
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F3b%252F943bfe42d9ccd3b32b9a27ed199a0185%252Fpa%252FDT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg saved to cache
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1
2026-03-28 20:33:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1da0c75b-2607-5e9c-adad-3f4bfff505a1, skipping ID generation
2026-03-28 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with scrape type 1
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1 sending to next pipeline
2026-03-28 20:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1da0c75b-2607-5e9c-adad-3f4bfff505a1, identifier: DT55223
2026-03-28 20:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175
2026-03-28 20:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17694848-4686-5cfa-bf4c-15b12b30fae3 with scrape type 1
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17694848-4686-5cfa-bf4c-15b12b30fae3
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_dfc8b27424a79bec0322e0a9a93f2621.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_dfc8b27424a79bec0322e0a9a93f2621.jpg already downloaded
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_456a5aa807f6370285f1c6797b973037.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_456a5aa807f6370285f1c6797b973037.jpg already downloaded
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_b5d9765eb92acf14beaebb77c806dd7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_b5d9765eb92acf14beaebb77c806dd7f.jpg already downloaded
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_33c30d301e630752f37fce50b43e80db.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_33c30d301e630752f37fce50b43e80db.jpg already downloaded
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_6d0aa1ac426a5a6539edf9ac14d5fd7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_6d0aa1ac426a5a6539edf9ac14d5fd7c.jpg already downloaded
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_98758c2338ea957ab82fb6ff179bfbb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_98758c2338ea957ab82fb6ff179bfbb2.jpg already downloaded
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_d1271e86d1ac4d426416cbb7fc616d47.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_d1271e86d1ac4d426416cbb7fc616d47.jpg already downloaded
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_a24e49aa36b01f45e346f3e63a03e277.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_a24e49aa36b01f45e346f3e63a03e277.jpg already downloaded
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_77f05b1b73c6fdc7de6351953fd86dc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_77f05b1b73c6fdc7de6351953fd86dc6.jpg already downloaded
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278d0c0d8f38718c9101d7079e159acc%252Fpa%252FYG03175_c178467bd7df4d2c9c41c496230203c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_c178467bd7df4d2c9c41c496230203c5.jpg already downloaded
2026-03-28 20:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17694848-4686-5cfa-bf4c-15b12b30fae3, identifier: YG03175
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_2a938b77529b1ba831128c22b01cabe2.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_2a938b77529b1ba831128c22b01cabe2.jpg not downloaded yet
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_a219b827b6fd0471465eaf79cae3e034.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_a219b827b6fd0471465eaf79cae3e034.jpg not downloaded yet
2026-03-28 20:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223
2026-03-28 20:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223
2026-03-28 20:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223 to the API
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:16:16Z',
 'fuel_type': 'diesel',
 'id': '1da0c75b-2607-5e9c-adad-3f4bfff505a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT55223',
 'listing': 'auction',
 'location': 'BE, Retie',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 161506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_048cb1158b8357a2c67d61f0bacb4e93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3094a095044812dce5696239964bf75d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_de02505fa6adb93f6ba8ed766d8afa48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_68003d9fa1f969faed637eadffcd9714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_7c1bff7466a91b0f8ed4555fcc1c6122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c19f313e7876ad03e398245aac2bc639.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_63ccee7fb572b50a51af096eac273627.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_3db1dd4d8922f1d9b3ede2f92570d0a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_c8f8047cecffaf8315cf4446caff687b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1da0c75b-2607-5e9c-adad-3f4bfff505a1/1da0c75b-2607-5e9c-adad-3f4bfff505a1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/3b/943bfe42d9ccd3b32b9a27ed199a0185/pa/DT55223_6e3f57bb8eba9a2c83af1ff2f2ad4812.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-24',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Ducato 3.0 JTD 180 Power',
 'transmission': 'manual',
 'trim': '180 Power',
 'year': 2016}
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [auto1.be] INFO: Saving data for DT55223: {'created_time': 1774730021.568409, 'last_price_update_time': 1774730021.568422, 'auction_closing_time': 1774883776.0}
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT55223') HTTP/1.1" 204 0
2026-03-28 20:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175
2026-03-28 20:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175
2026-03-28 20:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175 to the API
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG03175>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:57:48Z',
 'fuel_type': 'petrol',
 'id': '17694848-4686-5cfa-bf4c-15b12b30fae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG03175',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 148963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_dfc8b27424a79bec0322e0a9a93f2621.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_456a5aa807f6370285f1c6797b973037.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_b5d9765eb92acf14beaebb77c806dd7f.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_33c30d301e630752f37fce50b43e80db.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_6d0aa1ac426a5a6539edf9ac14d5fd7c.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_98758c2338ea957ab82fb6ff179bfbb2.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_d1271e86d1ac4d426416cbb7fc616d47.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_a24e49aa36b01f45e346f3e63a03e277.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_77f05b1b73c6fdc7de6351953fd86dc6.jpg',
                'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_c178467bd7df4d2c9c41c496230203c5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_dfc8b27424a79bec0322e0a9a93f2621.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3043430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_456a5aa807f6370285f1c6797b973037.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_b5d9765eb92acf14beaebb77c806dd7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_33c30d301e630752f37fce50b43e80db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2665083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_6d0aa1ac426a5a6539edf9ac14d5fd7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3197825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_98758c2338ea957ab82fb6ff179bfbb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_d1271e86d1ac4d426416cbb7fc616d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_a24e49aa36b01f45e346f3e63a03e277.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_77f05b1b73c6fdc7de6351953fd86dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17694848-4686-5cfa-bf4c-15b12b30fae3/17694848-4686-5cfa-bf4c-15b12b30fae3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278d0c0d8f38718c9101d7079e159acc/pa/YG03175_c178467bd7df4d2c9c41c496230203c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-28 20:33:41 [auto1.be] INFO: Saving data for YG03175: {'created_time': 1774730021.996778, 'last_price_update_time': 1774730021.996789, 'auction_closing_time': 1774886268.0}
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG03175') HTTP/1.1" 204 0
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_1e7b7cafce71e05cde67d74da5cb927f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_d757c2beeebe581f1a12aad09f8f104a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_35071ad88fe8ad2e351eed803d77f8a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_69bc1cb27ccc210922531aec84ece790.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69bc1cb27ccc210922531aec84ece790.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_0e7622d899ec42dc42567c733d52d998.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_0e7622d899ec42dc42567c733d52d998.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_98c885c976095898fb15a5a7c5f5555d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_98c885c976095898fb15a5a7c5f5555d.jpg not downloaded yet
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_7c182ab65375337de9749c137b2c8795.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_69b748c61924487a2a15391331759c1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69b748c61924487a2a15391331759c1c.jpg not downloaded yet
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_72dd925bfc04e924c9b8206ee8d63f5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_72dd925bfc04e924c9b8206ee8d63f5f.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_11535f63779ea18d8655b2a41bb25445.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_11535f63779ea18d8655b2a41bb25445.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_2bb784fd25b565ecf7ac8c1a18cf2727.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_2bb784fd25b565ecf7ac8c1a18cf2727.jpg not downloaded yet
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_272063f3f2737357a04bc8d2f3afe8a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_e929bc1c2668de0c4959de06b4093b7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_e929bc1c2668de0c4959de06b4093b7e.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_c96482eb63d70d8e79278b0b63101c31.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_c96482eb63d70d8e79278b0b63101c31.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_93378e7092e1c4632a64ccfa645fb407.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_93378e7092e1c4632a64ccfa645fb407.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_1a7c29467ce124734f3bbecc807b2dc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_1a7c29467ce124734f3bbecc807b2dc5.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_17c7cc7d237194ae032a9357023484b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_17c7cc7d237194ae032a9357023484b8.jpg not downloaded yet
2026-03-28 20:33:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17316a1d0>
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_1e7b7cafce71e05cde67d74da5cb927f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_1e7b7cafce71e05cde67d74da5cb927f.jpg saved to cache
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172528b90>
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_d757c2beeebe581f1a12aad09f8f104a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_d757c2beeebe581f1a12aad09f8f104a.jpg saved to cache
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726213d0>
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_35071ad88fe8ad2e351eed803d77f8a3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_35071ad88fe8ad2e351eed803d77f8a3.jpg saved to cache
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_702ab956d24f2cae43cd9f73e12fcf51.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_702ab956d24f2cae43cd9f73e12fcf51.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_ad33719e7bf407ac734e7fab672b2f11.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_ad33719e7bf407ac734e7fab672b2f11.jpg not downloaded yet
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg not downloaded yet
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725624d0>
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_7c182ab65375337de9749c137b2c8795.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_7c182ab65375337de9749c137b2c8795.jpg saved to cache
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172560450>
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F22%252F8a22a4b3b6b758a3a5dbd58a606c7382%252Fpa%252FZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg saved to cache
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb7cc53d-141f-5a8a-ba9f-c466980f1059
2026-03-28 20:33:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb7cc53d-141f-5a8a-ba9f-c466980f1059, skipping ID generation
2026-03-28 20:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7cc53d-141f-5a8a-ba9f-c466980f1059 with scrape type 1
2026-03-28 20:33:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb7cc53d-141f-5a8a-ba9f-c466980f1059 sending to next pipeline
2026-03-28 20:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb7cc53d-141f-5a8a-ba9f-c466980f1059, identifier: ZN30582
2026-03-28 20:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_89baf9f0efbabb0242e4991f68a634c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_7cbbee3f18bdb81db3851470d4c0e40a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_7cbbee3f18bdb81db3851470d4c0e40a.jpg not downloaded yet
2026-03-28 20:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582
2026-03-28 20:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582
2026-03-28 20:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582 to the API
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'petrol',
 'id': 'cb7cc53d-141f-5a8a-ba9f-c466980f1059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN30582',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 146956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2588482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_29a14263c72fa893a5ffd93a155266fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_89b5499719f719d11b760ab3bfc29a17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_f8a81490c2bf6a2677dbd2420971e991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_8d57003bf6256172596ed370be509204.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614837,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_dc74ffe44d44e3174ba5dfaf649fe572.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_7015c6b5eca8e0258e5f17d75f8f42ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_34bb88201f36d9434463a477c3bf3fba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_5b2d6027daf47442c83d1b846aabc608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_d757c2beeebe581f1a12aad09f8f104a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb7cc53d-141f-5a8a-ba9f-c466980f1059/cb7cc53d-141f-5a8a-ba9f-c466980f1059_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2523265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/22/8a22a4b3b6b758a3a5dbd58a606c7382/pa/ZN30582_1e7b7cafce71e05cde67d74da5cb927f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [auto1.be] INFO: Saving data for ZN30582: {'created_time': 1774730023.360618, 'last_price_update_time': 1774730023.36063, 'auction_closing_time': 1774883765.0}
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN30582') HTTP/1.1" 204 0
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_738ab8b229b850cc7791525afc5eb347.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_738ab8b229b850cc7791525afc5eb347.jpg not downloaded yet
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_4d7d730611d95942de38b302d634235b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_4d7d730611d95942de38b302d634235b.jpg not downloaded yet
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17306ff10>
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_272063f3f2737357a04bc8d2f3afe8a6.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_272063f3f2737357a04bc8d2f3afe8a6.jpg saved to cache
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_c04d81fb908e18c3b459c785058ec3ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_c04d81fb908e18c3b459c785058ec3ef.jpg not downloaded yet
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_b047b8a2eb2d18cbc6d11021e867379a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b047b8a2eb2d18cbc6d11021e867379a.jpg not downloaded yet
2026-03-28 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY36246> (referer: https://www.auto1.com/v1/car-details-view/VY36246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17210f150>
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_89baf9f0efbabb0242e4991f68a634c3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_89baf9f0efbabb0242e4991f68a634c3.jpg saved to cache
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_888098b927bf8e1642bb85a2841fba33.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:43 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1094 | hits on page: 0
2026-03-28 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b65fe87ea8ce2bfe403bc32ef55960b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_1a7c29467ce124734f3bbecc807b2dc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_38345b16f5fe264a61d4c9c01820e784.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246
2026-03-28 20:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915df589-6278-5af1-9457-45a9ffa8357a with scrape type 1
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 915df589-6278-5af1-9457-45a9ffa8357a
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_2eb9517ffd33e7e95ed53654333081e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_2eb9517ffd33e7e95ed53654333081e9.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_e1c42f53f3a338b59178df89662c812c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_e1c42f53f3a338b59178df89662c812c.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_5bf9984aba7d6b53732de717cc699a1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_5bf9984aba7d6b53732de717cc699a1d.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_7c4bd529392388f50518cbf33da61a98.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_7c4bd529392388f50518cbf33da61a98.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_8a68bb987c8ee6876b0d6ace48eeb259.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_8a68bb987c8ee6876b0d6ace48eeb259.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_1b375154593009a18a7eaf1f219fe46a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_1b375154593009a18a7eaf1f219fe46a.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_f5a60b05813ccdf9af313cb716d44d0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_f5a60b05813ccdf9af313cb716d44d0c.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_332bca8b703e784bf502f8cf473b4e38.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_332bca8b703e784bf502f8cf473b4e38.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_e15664e9dc8bdf29c89441e8cf850933.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_e15664e9dc8bdf29c89441e8cf850933.jpg already downloaded
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F5d%252F3a5d6cebe51c16e1a5d85194d5e85761%252Fpa%252FVY36246_ed5121f22bc1dda474789a277030e937.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_ed5121f22bc1dda474789a277030e937.jpg already downloaded
2026-03-28 20:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 915df589-6278-5af1-9457-45a9ffa8357a, identifier: VY36246
2026-03-28 20:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246
2026-03-28 20:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246
2026-03-28 20:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246 to the API
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY36246>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:03:28Z',
 'fuel_type': 'petrol',
 'id': '915df589-6278-5af1-9457-45a9ffa8357a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY36246',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 24125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_2eb9517ffd33e7e95ed53654333081e9.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_e1c42f53f3a338b59178df89662c812c.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_5bf9984aba7d6b53732de717cc699a1d.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_7c4bd529392388f50518cbf33da61a98.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_8a68bb987c8ee6876b0d6ace48eeb259.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_1b375154593009a18a7eaf1f219fe46a.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_f5a60b05813ccdf9af313cb716d44d0c.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_332bca8b703e784bf502f8cf473b4e38.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_e15664e9dc8bdf29c89441e8cf850933.jpg',
                'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_ed5121f22bc1dda474789a277030e937.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_2eb9517ffd33e7e95ed53654333081e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_e1c42f53f3a338b59178df89662c812c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_5bf9984aba7d6b53732de717cc699a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2718896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_7c4bd529392388f50518cbf33da61a98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_8a68bb987c8ee6876b0d6ace48eeb259.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_1b375154593009a18a7eaf1f219fe46a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_f5a60b05813ccdf9af313cb716d44d0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_332bca8b703e784bf502f8cf473b4e38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_e15664e9dc8bdf29c89441e8cf850933.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_915df589-6278-5af1-9457-45a9ffa8357a/915df589-6278-5af1-9457-45a9ffa8357a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/5d/3a5d6cebe51c16e1a5d85194d5e85761/pa/VY36246_ed5121f22bc1dda474789a277030e937.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 X 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2024}
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-28 20:33:44 [auto1.be] INFO: Saving data for VY36246: {'created_time': 1774730024.307092, 'last_price_update_time': 1774730024.307104, 'auction_closing_time': 1774883008.0}
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VY36246') HTTP/1.1" 204 0
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_72dd925bfc04e924c9b8206ee8d63f5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_702ab956d24f2cae43cd9f73e12fcf51.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_c96482eb63d70d8e79278b0b63101c31.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_e929bc1c2668de0c4959de06b4093b7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa179a1ab10>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_888098b927bf8e1642bb85a2841fba33.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_888098b927bf8e1642bb85a2841fba33.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f21110>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_b65fe87ea8ce2bfe403bc32ef55960b8.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b65fe87ea8ce2bfe403bc32ef55960b8.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725291d0>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_1a7c29467ce124734f3bbecc807b2dc5.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_1a7c29467ce124734f3bbecc807b2dc5.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172f01850>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_38345b16f5fe264a61d4c9c01820e784.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_38345b16f5fe264a61d4c9c01820e784.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a2d10>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_72dd925bfc04e924c9b8206ee8d63f5f.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_72dd925bfc04e924c9b8206ee8d63f5f.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17328d550>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_702ab956d24f2cae43cd9f73e12fcf51.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_702ab956d24f2cae43cd9f73e12fcf51.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308bd50>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_c96482eb63d70d8e79278b0b63101c31.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_c96482eb63d70d8e79278b0b63101c31.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308b4d0>
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_e929bc1c2668de0c4959de06b4093b7e.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_e929bc1c2668de0c4959de06b4093b7e.jpg saved to cache
2026-03-28 20:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_738ab8b229b850cc7791525afc5eb347.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_4d7d730611d95942de38b302d634235b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_93378e7092e1c4632a64ccfa645fb407.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_17c7cc7d237194ae032a9357023484b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_2bb784fd25b565ecf7ac8c1a18cf2727.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69b748c61924487a2a15391331759c1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_11535f63779ea18d8655b2a41bb25445.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_c04d81fb908e18c3b459c785058ec3ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b047b8a2eb2d18cbc6d11021e867379a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_0e7622d899ec42dc42567c733d52d998.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721a3ad0>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_738ab8b229b850cc7791525afc5eb347.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_738ab8b229b850cc7791525afc5eb347.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_ad33719e7bf407ac734e7fab672b2f11.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1730bccd0>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_4d7d730611d95942de38b302d634235b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_4d7d730611d95942de38b302d634235b.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_7cbbee3f18bdb81db3851470d4c0e40a.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_a219b827b6fd0471465eaf79cae3e034.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_2a938b77529b1ba831128c22b01cabe2.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1731cd710>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_93378e7092e1c4632a64ccfa645fb407.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_93378e7092e1c4632a64ccfa645fb407.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a60d0>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_17c7cc7d237194ae032a9357023484b8.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_17c7cc7d237194ae032a9357023484b8.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1732a2090>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_2bb784fd25b565ecf7ac8c1a18cf2727.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_2bb784fd25b565ecf7ac8c1a18cf2727.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17260b890>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_69b748c61924487a2a15391331759c1c.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69b748c61924487a2a15391331759c1c.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1721a0c90>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_11535f63779ea18d8655b2a41bb25445.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_11535f63779ea18d8655b2a41bb25445.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173089690>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_c04d81fb908e18c3b459c785058ec3ef.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_c04d81fb908e18c3b459c785058ec3ef.jpg saved to cache
2026-03-28 20:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17308e950>
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_b047b8a2eb2d18cbc6d11021e867379a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b047b8a2eb2d18cbc6d11021e867379a.jpg saved to cache
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17303c790>
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_0e7622d899ec42dc42567c733d52d998.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_0e7622d899ec42dc42567c733d52d998.jpg saved to cache
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa173083f90>
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_ad33719e7bf407ac734e7fab672b2f11.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_ad33719e7bf407ac734e7fab672b2f11.jpg saved to cache
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172fed610>
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_7cbbee3f18bdb81db3851470d4c0e40a.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_7cbbee3f18bdb81db3851470d4c0e40a.jpg saved to cache
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa172534910>
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_a219b827b6fd0471465eaf79cae3e034.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_a219b827b6fd0471465eaf79cae3e034.jpg saved to cache
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1726543d0>
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_2.jpg HTTP/1.1" 201 0
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F4f%252F5d4f1903ea006e04582523d64832d1d5%252Fpa%252FZY24236_2a938b77529b1ba831128c22b01cabe2.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_2a938b77529b1ba831128c22b01cabe2.jpg saved to cache
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61
2026-03-28 20:33:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61, skipping ID generation
2026-03-28 20:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with scrape type 1
2026-03-28 20:33:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 sending to next pipeline
2026-03-28 20:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61, identifier: ZY24236
2026-03-28 20:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236
2026-03-28 20:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236
2026-03-28 20:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236 to the API
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_2a938b77529b1ba831128c22b01cabe2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 77,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:38:02Z',
 'fuel_type': 'hybrid',
 'id': '58b0c11d-f45f-5db5-8d6a-26a4be56ed61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY24236',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 251819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_7c182ab65375337de9749c137b2c8795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_272063f3f2737357a04bc8d2f3afe8a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_2a938b77529b1ba831128c22b01cabe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_0e7622d899ec42dc42567c733d52d998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_72dd925bfc04e924c9b8206ee8d63f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_e929bc1c2668de0c4959de06b4093b7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_1a7c29467ce124734f3bbecc807b2dc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_ad33719e7bf407ac734e7fab672b2f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_738ab8b229b850cc7791525afc5eb347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b0c11d-f45f-5db5-8d6a-26a4be56ed61/58b0c11d-f45f-5db5-8d6a-26a4be56ed61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/4f/5d4f1903ea006e04582523d64832d1d5/pa/ZY24236_c04d81fb908e18c3b459c785058ec3ef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-28 20:33:46 [auto1.be] INFO: Saving data for ZY24236: {'created_time': 1774730026.98187, 'last_price_update_time': 1774730026.981883, 'auction_closing_time': 1774885082.0}
2026-03-28 20:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY24236') HTTP/1.1" 204 0
2026-03-28 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_98c885c976095898fb15a5a7c5f5555d.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_029ace73a8060d8c42719ee15568055b.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69bc1cb27ccc210922531aec84ece790.jpg> (referer: https://www.auto1.com/)
2026-03-28 20:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790df090>
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_98c885c976095898fb15a5a7c5f5555d.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_98c885c976095898fb15a5a7c5f5555d.jpg saved to cache
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1790ddb90>
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F41%252F4441bf8f1ab7a45456d8d3b8d70226be%252Fpa%252FMJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg saved to cache
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b5cc812-8365-50da-b6f4-19fff86690e6
2026-03-28 20:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b5cc812-8365-50da-b6f4-19fff86690e6, skipping ID generation
2026-03-28 20:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5cc812-8365-50da-b6f4-19fff86690e6 with scrape type 1
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b5cc812-8365-50da-b6f4-19fff86690e6 sending to next pipeline
2026-03-28 20:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b5cc812-8365-50da-b6f4-19fff86690e6, identifier: MJ04907
2026-03-28 20:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907
2026-03-28 20:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907
2026-03-28 20:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907 to the API
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:53:08Z',
 'fuel_type': 'diesel',
 'id': '6b5cc812-8365-50da-b6f4-19fff86690e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ04907',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 193071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2669703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_888098b927bf8e1642bb85a2841fba33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b65fe87ea8ce2bfe403bc32ef55960b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_a219b827b6fd0471465eaf79cae3e034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_98c885c976095898fb15a5a7c5f5555d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2668099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_11535f63779ea18d8655b2a41bb25445.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_c96482eb63d70d8e79278b0b63101c31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_17c7cc7d237194ae032a9357023484b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_7b35e42df0901a3a3ea53ed2cfcee5f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_4d7d730611d95942de38b302d634235b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5cc812-8365-50da-b6f4-19fff86690e6/6b5cc812-8365-50da-b6f4-19fff86690e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/41/4441bf8f1ab7a45456d8d3b8d70226be/pa/MJ04907_b047b8a2eb2d18cbc6d11021e867379a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Edition 7 4WD',
 'transmission': 'automatic',
 'trim': 'Edition 7 4WD',
 'year': 2018}
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-28 20:33:47 [auto1.be] INFO: Saving data for MJ04907: {'created_time': 1774730027.868112, 'last_price_update_time': 1774730027.868123, 'auction_closing_time': 1774885988.0}
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ04907') HTTP/1.1" 204 0
2026-03-28 20:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa17310acd0>
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_029ace73a8060d8c42719ee15568055b.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_029ace73a8060d8c42719ee15568055b.jpg saved to cache
2026-03-28 20:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa1725670d0>
2026-03-28 20:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 20:33:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F7d%252F5a7d87b85b18496b61abc065f02ea17d%252Fpa%252FZZ74713_69bc1cb27ccc210922531aec84ece790.jpg') HTTP/1.1" 204 0
2026-03-28 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69bc1cb27ccc210922531aec84ece790.jpg saved to cache
2026-03-28 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2
2026-03-28 20:33:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2, skipping ID generation
2026-03-28 20:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with scrape type 1
2026-03-28 20:33:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 sending to next pipeline
2026-03-28 20:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2, identifier: ZZ74713
2026-03-28 20:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713
2026-03-28 20:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713
2026-03-28 20:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713 to the API
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69bc1cb27ccc210922531aec84ece790.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'petrol',
 'id': '5202aaac-ea13-5098-944c-6f6e7b2ab5b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ74713',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 163114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_35071ad88fe8ad2e351eed803d77f8a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3378075,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_38345b16f5fe264a61d4c9c01820e784.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_89baf9f0efbabb0242e4991f68a634c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3071891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_029ace73a8060d8c42719ee15568055b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3031085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69bc1cb27ccc210922531aec84ece790.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_69b748c61924487a2a15391331759c1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2002341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_2bb784fd25b565ecf7ac8c1a18cf2727.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_93378e7092e1c4632a64ccfa645fb407.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_702ab956d24f2cae43cd9f73e12fcf51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5202aaac-ea13-5098-944c-6f6e7b2ab5b2/5202aaac-ea13-5098-944c-6f6e7b2ab5b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/7d/5a7d87b85b18496b61abc065f02ea17d/pa/ZZ74713_7cbbee3f18bdb81db3851470d4c0e40a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2019}
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-28 20:33:48 [auto1.be] INFO: Saving data for ZZ74713: {'created_time': 1774730028.556237, 'last_price_update_time': 1774730028.55625, 'auction_closing_time': 1774884360.0}
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ74713') HTTP/1.1" 204 0
2026-03-28 20:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD67660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 20:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD67660> (referer: https://www.auto1.com/v1/car-details-view/XD67660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 20:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660
2026-03-28 20:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with scrape type 1
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9cd90119-5bf5-52a8-b1c5-13e50e63be47
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_169dc1bfc399aedb9bf6b7fe32c094d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_169dc1bfc399aedb9bf6b7fe32c094d6.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_bdadabfe4dba4a7b65968318349b23a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_bdadabfe4dba4a7b65968318349b23a1.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_6c9e30d403594110913b031929b5aa4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_6c9e30d403594110913b031929b5aa4a.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_5880223f631a5e663f099cbd15a24383.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_5880223f631a5e663f099cbd15a24383.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_ceaed67dcf1b78bd97b6453bf6ac945b.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_ceaed67dcf1b78bd97b6453bf6ac945b.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_f0042e014f4d9d226655dc7b6e32b18d.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_f0042e014f4d9d226655dc7b6e32b18d.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_48fd2f41d2e5aa8171e24cb62922fd29.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_48fd2f41d2e5aa8171e24cb62922fd29.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_ad759fdc8b487fdc7a9a1180811620f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_ad759fdc8b487fdc7a9a1180811620f5.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_e9d92f4dd7c75416f384309d810f7971.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_e9d92f4dd7c75416f384309d810f7971.jpg already downloaded
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F50%252Fb450224fc2d36c3dfd770390cfa8327d%252Fpa%252FXD67660_891ee0309fb936199796ec03d4835fd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 20:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_891ee0309fb936199796ec03d4835fd8.jpg already downloaded
2026-03-28 20:34:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9cd90119-5bf5-52a8-b1c5-13e50e63be47, identifier: XD67660
2026-03-28 20:34:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660
2026-03-28 20:34:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660
2026-03-28 20:34:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660 to the API
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 20:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 20:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD67660>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:41:22Z',
 'fuel_type': 'petrol',
 'id': '9cd90119-5bf5-52a8-b1c5-13e50e63be47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD67660',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 31513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_169dc1bfc399aedb9bf6b7fe32c094d6.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_bdadabfe4dba4a7b65968318349b23a1.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_6c9e30d403594110913b031929b5aa4a.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_5880223f631a5e663f099cbd15a24383.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_ceaed67dcf1b78bd97b6453bf6ac945b.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_f0042e014f4d9d226655dc7b6e32b18d.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_48fd2f41d2e5aa8171e24cb62922fd29.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_ad759fdc8b487fdc7a9a1180811620f5.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_e9d92f4dd7c75416f384309d810f7971.jpg',
                'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_891ee0309fb936199796ec03d4835fd8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_169dc1bfc399aedb9bf6b7fe32c094d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_bdadabfe4dba4a7b65968318349b23a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_6c9e30d403594110913b031929b5aa4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_5880223f631a5e663f099cbd15a24383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_ceaed67dcf1b78bd97b6453bf6ac945b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_f0042e014f4d9d226655dc7b6e32b18d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_48fd2f41d2e5aa8171e24cb62922fd29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_ad759fdc8b487fdc7a9a1180811620f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_e9d92f4dd7c75416f384309d810f7971.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cd90119-5bf5-52a8-b1c5-13e50e63be47/9cd90119-5bf5-52a8-b1c5-13e50e63be47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/50/b450224fc2d36c3dfd770390cfa8327d/pa/XD67660_891ee0309fb936199796ec03d4835fd8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-28 20:34:04 [auto1.be] INFO: Saving data for XD67660: {'created_time': 1774730044.066561, 'last_price_update_time': 1774730044.066574, 'auction_closing_time': 1774885282.0}
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD67660') HTTP/1.1" 204 0
2026-03-28 20:34:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 20:34:04 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-28 20:34:04 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774298044 HTTP/1.1" 200 None
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AL70989') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AU25214') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BA07598') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BE52621') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BG37433') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BH24528') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CD49334') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CJ22528') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CM14446') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CS28388') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CS33823') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DG16285') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ91657') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DM71739') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EH16070') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EV29357') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EX12539') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FD19965') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FE02636') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FG00312') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FK62010') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FR22237') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FZ42256') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GN69495') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GP57943') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GP75979') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GW45059') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GX69570') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HP35230') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HR27836') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HW15062') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HW94885') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ53432') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JR66002') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JT47699') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KE75098') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KG43594') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KK23222') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KT75925') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KX42195') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KY72759') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LD61278') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LM83246') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LR30664') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LS07950') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LV99895') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LX64927') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MA44001') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MF53347') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ06127') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MR39522') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MX03805') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NC29971') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ND58257') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NV58841') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NY10838') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NY44737') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PB30574') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PL94274') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PT38126') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PT80840') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RB76230') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RC58092') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RF64682') HTTP/1.1" 204 0
2026-03-28 20:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RV06226') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RY27420') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SC98464') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ57197') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SS25260') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TE04501') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TR04558') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TR09266') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ32210') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UE92117') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='US18314') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UU60100') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UX89863') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VC77463') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VM57836') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VT22075') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VT37797') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VV58009') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VW78018') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VY50067') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VY89868') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WC25372') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WF96031') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WN13679') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WN34169') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WS43978') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XE47727') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XK76267') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XN77077') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YB82981') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YE16618') HTTP/1.1" 204 0
2026-03-28 20:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YP88075') HTTP/1.1" 204 0
2026-03-28 20:34:05 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (170 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-28T20_30_00.jl
2026-03-28 20:34:05 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1177292,
 'downloader/request_count': 693,
 'downloader/request_method_count/GET': 662,
 'downloader/request_method_count/POST': 31,
 'downloader/response_bytes': 416187168,
 'downloader/response_count': 693,
 'downloader/response_status_count/200': 693,
 'dupefilter/filtered': 10,
 'elapsed_time_seconds': 238.440728,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 20, 34, 5, 322525, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 170,
 'log_count/DEBUG': 7336,
 'log_count/INFO': 6972,
 'memusage/max': 201388032,
 'memusage/startup': 150056960,
 'photo_download_count': 478,
 'request_depth_max': 32,
 'response_received_count': 215,
 'scheduler/dequeued': 693,
 'scheduler/dequeued/memory': 693,
 'scheduler/enqueued': 693,
 'scheduler/enqueued/memory': 693,
 'scrape_type/batch_skipped': 555,
 'scrape_type/new': 91,
 'scrape_type/price_update': 79,
 'scrape_type/skipped': 399,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 215,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.048285218726757,
 'scrapy-zyte-api/mean_response_seconds': 3.0784733622031677,
 'scrapy-zyte-api/processed': 215,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 215,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 214,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 215,
 'scrapy-zyte-api/request_args/httpRequestBody': 31,
 'scrapy-zyte-api/request_args/httpRequestMethod': 31,
 'scrapy-zyte-api/request_args/httpResponseBody': 215,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 215,
 'scrapy-zyte-api/request_args/sessionContext': 215,
 'scrapy-zyte-api/request_args/url': 215,
 'scrapy-zyte-api/status_codes/200': 215,
 'scrapy-zyte-api/success': 215,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1134,
 'source/total_available': 1094,
 'start_time': datetime.datetime(2026, 3, 28, 20, 30, 6, 881797, tzinfo=datetime.timezone.utc)}
2026-03-28 20:34:05 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 20:34:05 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa179156b90>
2026-03-28 20:34:05 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fa1792ac210>