2026-03-30 11:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-30 11:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-30 11:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 003c08f71bcb9a1f
2026-03-30 11:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-30T11_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 11:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 11:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 11:30:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:30:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:30:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:30:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:30:07 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:30:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:30:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 11:30:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 11:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:30:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:07 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 152MiB
2026-03-30 11:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:31:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:32:01 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1750 | hits on page: 40
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: LP20527
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: BR51057
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: NA05180
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: RX63539
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX63539%27 HTTP/1.1" 200 None
2026-03-30 11:32:01 [auto1.be] INFO: Scrape type for RX63539: 1
2026-03-30 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: CC31408
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC31408%27 HTTP/1.1" 200 None
2026-03-30 11:32:01 [auto1.be] INFO: Scrape type for CC31408: 1
2026-03-30 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: FB83795
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: KR73371
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: AY86214
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: BZ56552
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ56552%27 HTTP/1.1" 200 None
2026-03-30 11:32:01 [auto1.be] INFO: Scrape type for BZ56552: 1
2026-03-30 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: NC36206
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: DP60606
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: UF96897
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: EU06132
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU06132%27 HTTP/1.1" 200 None
2026-03-30 11:32:01 [auto1.be] INFO: Scrape type for EU06132: 1
2026-03-30 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: PT50790
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: HX83389
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: PA62329
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA62329%27 HTTP/1.1" 200 None
2026-03-30 11:32:01 [auto1.be] INFO: Scrape type for PA62329: 1
2026-03-30 11:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: ME23614
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: NT28304
2026-03-30 11:32:01 [auto1.be] INFO: Found listing with ID: KE14045
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE14045%27 HTTP/1.1" 200 None
2026-03-30 11:32:01 [auto1.be] INFO: Scrape type for KE14045: 2
2026-03-30 11:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b70207-777f-5a0e-ab7b-e5bad2beeb33 with identifier: KE14045
2026-03-30 11:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b70207-777f-5a0e-ab7b-e5bad2beeb33 with scrape type 2
2026-03-30 11:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b70207-777f-5a0e-ab7b-e5bad2beeb33 with scrape type 2
2026-03-30 11:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 50b70207-777f-5a0e-ab7b-e5bad2beeb33, identifier: KE14045
2026-03-30 11:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 50b70207-777f-5a0e-ab7b-e5bad2beeb33 with identifier: KE14045
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:32:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 50b70207-777f-5a0e-ab7b-e5bad2beeb33 with identifier: KE14045
2026-03-30 11:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 50b70207-777f-5a0e-ab7b-e5bad2beeb33 with identifier: KE14045 to the API
2026-03-30 11:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:25:11Z',
 'fuel_type': 'petrol',
 'id': '50b70207-777f-5a0e-ab7b-e5bad2beeb33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE14045',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 158446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE14045%27 HTTP/1.1" 200 None
2026-03-30 11:32:03 [auto1.be] INFO: Saving data for KE14045: {'auction_closing_time': 1774970711.0, 'created_time': 1774254693.279765, 'last_price_update_time': 1774870323.159887}
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE14045') HTTP/1.1" 204 0
2026-03-30 11:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:03 [auto1.be] INFO: Found listing with ID: HX20091
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX20091%27 HTTP/1.1" 200 None
2026-03-30 11:32:03 [auto1.be] INFO: Scrape type for HX20091: 2
2026-03-30 11:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c with identifier: HX20091
2026-03-30 11:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c with scrape type 2
2026-03-30 11:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c with scrape type 2
2026-03-30 11:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c, identifier: HX20091
2026-03-30 11:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c with identifier: HX20091
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:32:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c with identifier: HX20091
2026-03-30 11:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c with identifier: HX20091 to the API
2026-03-30 11:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:11Z',
 'fuel_type': 'petrol',
 'id': 'b9fb9591-a7c1-5ebb-a30f-fca4b67c5b7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX20091',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 88594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-21',
 'seller_name': None,
 'title': 'Volvo V40 1.6 T3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2013}
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX20091%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Saving data for HX20091: {'auction_closing_time': 1774970111.0, 'created_time': 1773132586.385696, 'last_price_update_time': 1774870324.360771}
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX20091') HTTP/1.1" 204 0
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: JF63760
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF63760%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for JF63760: 1
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: GZ81291
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ81291%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for GZ81291: 1
2026-03-30 11:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: SG12556
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG12556%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for SG12556: 1
2026-03-30 11:32:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: HH54390
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH54390%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for HH54390: 1
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: GE72879
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE72879%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for GE72879: 1
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: AT59438
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT59438%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for AT59438: 1
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: UL07938
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL07938%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for UL07938: 1
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: YV19532
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV19532%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for YV19532: 1
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: JA94811
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: WS04196
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: YW96684
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: TL11462
2026-03-30 11:32:04 [auto1.be] INFO: Found listing with ID: ZF22511
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF22511%27 HTTP/1.1" 200 None
2026-03-30 11:32:04 [auto1.be] INFO: Scrape type for ZF22511: 2
2026-03-30 11:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b05478-b2fc-5fb4-8378-b853a61f31c1 with identifier: ZF22511
2026-03-30 11:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b05478-b2fc-5fb4-8378-b853a61f31c1 with scrape type 2
2026-03-30 11:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b05478-b2fc-5fb4-8378-b853a61f31c1 with scrape type 2
2026-03-30 11:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94b05478-b2fc-5fb4-8378-b853a61f31c1, identifier: ZF22511
2026-03-30 11:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94b05478-b2fc-5fb4-8378-b853a61f31c1 with identifier: ZF22511
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:32:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94b05478-b2fc-5fb4-8378-b853a61f31c1 with identifier: ZF22511
2026-03-30 11:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94b05478-b2fc-5fb4-8378-b853a61f31c1 with identifier: ZF22511 to the API
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:37:20Z',
 'fuel_type': 'diesel',
 'id': '94b05478-b2fc-5fb4-8378-b853a61f31c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF22511',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 6894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-20',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2025}
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF22511%27 HTTP/1.1" 200 None
2026-03-30 11:32:05 [auto1.be] INFO: Saving data for ZF22511: {'auction_closing_time': 1774971440.0, 'created_time': 1773661580.070058, 'last_price_update_time': 1774870325.336891}
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF22511') HTTP/1.1" 204 0
2026-03-30 11:32:05 [auto1.be] INFO: Found listing with ID: ZH30880
2026-03-30 11:32:05 [auto1.be] INFO: Found listing with ID: XG33358
2026-03-30 11:32:05 [auto1.be] INFO: Found listing with ID: UD24749
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD24749%27 HTTP/1.1" 200 None
2026-03-30 11:32:05 [auto1.be] INFO: Scrape type for UD24749: 1
2026-03-30 11:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX63539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:05 [auto1.be] INFO: Found listing with ID: GY85550
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GY85550%27 HTTP/1.1" 200 None
2026-03-30 11:32:05 [auto1.be] INFO: Scrape type for GY85550: 1
2026-03-30 11:32:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA62329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:07 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 4 pages/min), scraped 3 items (at 3 items/min)
2026-03-30 11:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 11:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH54390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU06132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:12 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1750 | hits on page: 40
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: LP20527
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: BR51057
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: NA05180
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: RX63539
2026-03-30 11:32:12 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RX63539/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: CC31408
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: FB83795
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: KR73371
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: AY86214
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: BZ56552
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: NC36206
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: DP60606
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: UF96897
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: EU06132
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: PT50790
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: HX83389
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: PA62329
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: ME23614
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: NT28304
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: KE14045
2026-03-30 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE14045%27 HTTP/1.1" 200 None
2026-03-30 11:32:12 [auto1.be] INFO: Scrape type for KE14045: 0
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: HX20091
2026-03-30 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX20091%27 HTTP/1.1" 200 None
2026-03-30 11:32:12 [auto1.be] INFO: Scrape type for HX20091: 0
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: JF63760
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: GZ81291
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: SG12556
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: HH54390
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: GE72879
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: AT59438
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: UL07938
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: YV19532
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: JA94811
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: WS04196
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: YW96684
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: TL11462
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: ZF22511
2026-03-30 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF22511%27 HTTP/1.1" 200 None
2026-03-30 11:32:12 [auto1.be] INFO: Scrape type for ZF22511: 0
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: ZH30880
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: XG33358
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: UD24749
2026-03-30 11:32:12 [auto1.be] INFO: Found listing with ID: GY85550
2026-03-30 11:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC31408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE72879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG12556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV19532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY85550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD24749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX63539> (referer: https://www.auto1.com/v1/car-details-view/RX63539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ad0ebc-1452-57b4-a6f2-187cee6debb7 with identifier: RX63539
2026-03-30 11:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7 with scrape type 1
2026-03-30 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_21f1492be92408effb9c3eabbc5f9784.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_21f1492be92408effb9c3eabbc5f9784.jpg not downloaded yet
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_bb645f89a36e7941979d3d246b073f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_bb645f89a36e7941979d3d246b073f5d.jpg not downloaded yet
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_617c25b3a318bafaff6f19aecde45b49.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_617c25b3a318bafaff6f19aecde45b49.jpg not downloaded yet
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_b6d359230a7feab3a41722f3a1afcfcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_b6d359230a7feab3a41722f3a1afcfcb.jpg not downloaded yet
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_72b8f07de600ceb502e3b6973ba068ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_72b8f07de600ceb502e3b6973ba068ff.jpg not downloaded yet
2026-03-30 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_21f1492be92408effb9c3eabbc5f9784.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_72b8f07de600ceb502e3b6973ba068ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:32:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:32:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea190510>
2026-03-30 11:32:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_21f1492be92408effb9c3eabbc5f9784.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_21f1492be92408effb9c3eabbc5f9784.jpg saved to cache
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7
2026-03-30 11:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_b6d359230a7feab3a41722f3a1afcfcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea191ad0>
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_72b8f07de600ceb502e3b6973ba068ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_72b8f07de600ceb502e3b6973ba068ff.jpg saved to cache
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7
2026-03-30 11:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_617c25b3a318bafaff6f19aecde45b49.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_bb645f89a36e7941979d3d246b073f5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea132110>
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_b6d359230a7feab3a41722f3a1afcfcb.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_b6d359230a7feab3a41722f3a1afcfcb.jpg saved to cache
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22c1d0>
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_617c25b3a318bafaff6f19aecde45b49.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_617c25b3a318bafaff6f19aecde45b49.jpg saved to cache
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0ba950>
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F19%252F491983fd21cf8c1eadcb7d2f77d3625b%252Fpa%252FRX63539_bb645f89a36e7941979d3d246b073f5d.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_bb645f89a36e7941979d3d246b073f5d.jpg saved to cache
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7
2026-03-30 11:32:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7ad0ebc-1452-57b4-a6f2-187cee6debb7, skipping ID generation
2026-03-30 11:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7 with scrape type 1
2026-03-30 11:32:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7ad0ebc-1452-57b4-a6f2-187cee6debb7 sending to next pipeline
2026-03-30 11:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7ad0ebc-1452-57b4-a6f2-187cee6debb7, identifier: RX63539
2026-03-30 11:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7ad0ebc-1452-57b4-a6f2-187cee6debb7 with identifier: RX63539
2026-03-30 11:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7ad0ebc-1452-57b4-a6f2-187cee6debb7 with identifier: RX63539
2026-03-30 11:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7ad0ebc-1452-57b4-a6f2-187cee6debb7 with identifier: RX63539 to the API
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_bb645f89a36e7941979d3d246b073f5d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:52:11Z',
 'fuel_type': 'diesel',
 'id': 'd7ad0ebc-1452-57b4-a6f2-187cee6debb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX63539',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 252472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_21f1492be92408effb9c3eabbc5f9784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_bb645f89a36e7941979d3d246b073f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_617c25b3a318bafaff6f19aecde45b49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_b6d359230a7feab3a41722f3a1afcfcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ad0ebc-1452-57b4-a6f2-187cee6debb7/d7ad0ebc-1452-57b4-a6f2-187cee6debb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/19/491983fd21cf8c1eadcb7d2f77d3625b/pa/RX63539_72b8f07de600ceb502e3b6973ba068ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.9 DDiS DDIS Family Comfort+',
 'transmission': 'manual',
 'trim': 'DDIS Family Comfort+',
 'year': 2008}
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX63539%27 HTTP/1.1" 200 None
2026-03-30 11:32:26 [auto1.be] INFO: Saving data for RX63539: {'created_time': 1774870346.960236, 'last_price_update_time': 1774870346.960252, 'auction_closing_time': 1774972331.0}
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX63539') HTTP/1.1" 204 0
2026-03-30 11:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH54390> (referer: https://www.auto1.com/v1/car-details-view/HH54390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0afb3b-3053-5c59-8f94-975e259ea6d8 with identifier: HH54390
2026-03-30 11:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8 with scrape type 1
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_5b15bc47ea0f2b6b152224077bc2b02c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_5b15bc47ea0f2b6b152224077bc2b02c.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_bf53203010a5a832ac34b346e5eb115d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_bf53203010a5a832ac34b346e5eb115d.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_7e1412191740b6a0bde48d2848309ae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_7e1412191740b6a0bde48d2848309ae2.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_3e9acd4ac0f1d62ad14fc2d6fc43ee87.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_3e9acd4ac0f1d62ad14fc2d6fc43ee87.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_edb3d337b280c50294aecd89681a0ef3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_edb3d337b280c50294aecd89681a0ef3.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_097dc74be54db60d1caae62b220643cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_097dc74be54db60d1caae62b220643cf.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_8436f96a8fa7d4a94a16ef91f20747f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_8436f96a8fa7d4a94a16ef91f20747f6.jpg not downloaded yet
2026-03-30 11:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_5b15bc47ea0f2b6b152224077bc2b02c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_d278d7a3f9d7b212f124cead67554b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_d278d7a3f9d7b212f124cead67554b0a.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_89622800a5dcac50a8a4527d8792dac3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_89622800a5dcac50a8a4527d8792dac3.jpg not downloaded yet
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_90856cbc0413ae5180f9de5543353f21.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_90856cbc0413ae5180f9de5543353f21.jpg not downloaded yet
2026-03-30 11:32:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea191bd0>
2026-03-30 11:32:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_5b15bc47ea0f2b6b152224077bc2b02c.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_5b15bc47ea0f2b6b152224077bc2b02c.jpg saved to cache
2026-03-30 11:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_bf53203010a5a832ac34b346e5eb115d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_90856cbc0413ae5180f9de5543353f21.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_89622800a5dcac50a8a4527d8792dac3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_8436f96a8fa7d4a94a16ef91f20747f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b1a90>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_bf53203010a5a832ac34b346e5eb115d.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_bf53203010a5a832ac34b346e5eb115d.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_d278d7a3f9d7b212f124cead67554b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec062a50>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_90856cbc0413ae5180f9de5543353f21.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_90856cbc0413ae5180f9de5543353f21.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea116710>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_89622800a5dcac50a8a4527d8792dac3.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_89622800a5dcac50a8a4527d8792dac3.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fcf90>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_8436f96a8fa7d4a94a16ef91f20747f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_8436f96a8fa7d4a94a16ef91f20747f6.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_edb3d337b280c50294aecd89681a0ef3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_097dc74be54db60d1caae62b220643cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e980a090>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_d278d7a3f9d7b212f124cead67554b0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_d278d7a3f9d7b212f124cead67554b0a.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_3e9acd4ac0f1d62ad14fc2d6fc43ee87.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_7e1412191740b6a0bde48d2848309ae2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9808750>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_edb3d337b280c50294aecd89681a0ef3.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_edb3d337b280c50294aecd89681a0ef3.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea20a910>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_097dc74be54db60d1caae62b220643cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_097dc74be54db60d1caae62b220643cf.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d2d10>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_3e9acd4ac0f1d62ad14fc2d6fc43ee87.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_3e9acd4ac0f1d62ad14fc2d6fc43ee87.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec063890>
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fa9%252F7ea9fb69fc8293cf86f7d0cde1e94e40%252Fpa%252FHH54390_7e1412191740b6a0bde48d2848309ae2.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_7e1412191740b6a0bde48d2848309ae2.jpg saved to cache
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8
2026-03-30 11:32:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a0afb3b-3053-5c59-8f94-975e259ea6d8, skipping ID generation
2026-03-30 11:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8 with scrape type 1
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a0afb3b-3053-5c59-8f94-975e259ea6d8 sending to next pipeline
2026-03-30 11:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a0afb3b-3053-5c59-8f94-975e259ea6d8, identifier: HH54390
2026-03-30 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a0afb3b-3053-5c59-8f94-975e259ea6d8 with identifier: HH54390
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a0afb3b-3053-5c59-8f94-975e259ea6d8 with identifier: HH54390
2026-03-30 11:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a0afb3b-3053-5c59-8f94-975e259ea6d8 with identifier: HH54390 to the API
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_7e1412191740b6a0bde48d2848309ae2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:46:04Z',
 'fuel_type': 'diesel',
 'id': '5a0afb3b-3053-5c59-8f94-975e259ea6d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH54390',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 135624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_5b15bc47ea0f2b6b152224077bc2b02c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_bf53203010a5a832ac34b346e5eb115d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_7e1412191740b6a0bde48d2848309ae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_3e9acd4ac0f1d62ad14fc2d6fc43ee87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_edb3d337b280c50294aecd89681a0ef3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_097dc74be54db60d1caae62b220643cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_8436f96a8fa7d4a94a16ef91f20747f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_d278d7a3f9d7b212f124cead67554b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_89622800a5dcac50a8a4527d8792dac3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a0afb3b-3053-5c59-8f94-975e259ea6d8/5a0afb3b-3053-5c59-8f94-975e259ea6d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/a9/7ea9fb69fc8293cf86f7d0cde1e94e40/pa/HH54390_90856cbc0413ae5180f9de5543353f21.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L3H2 HKa 3,5t',
 'transmission': 'manual',
 'trim': 'L3H2 HKa 3,5t',
 'year': 2012}
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH54390%27 HTTP/1.1" 200 None
2026-03-30 11:32:29 [auto1.be] INFO: Saving data for HH54390: {'created_time': 1774870349.243728, 'last_price_update_time': 1774870349.243742, 'auction_closing_time': 1774971964.0}
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH54390') HTTP/1.1" 204 0
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU06132> (referer: https://www.auto1.com/v1/car-details-view/EU06132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a93276-0114-5af3-ac84-55e6272a3868 with identifier: EU06132
2026-03-30 11:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a93276-0114-5af3-ac84-55e6272a3868 with scrape type 1
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_562a3e01fd90c9bfd9bf80f9b9ebc973.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_562a3e01fd90c9bfd9bf80f9b9ebc973.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_6b77aef28a84c3acc2d8fe2f87bb044e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_6b77aef28a84c3acc2d8fe2f87bb044e.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_69518621ddd7bc51359f84341cdabce6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_69518621ddd7bc51359f84341cdabce6.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_b02378e5b81fe145f206f2c3d3e6bf1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_b02378e5b81fe145f206f2c3d3e6bf1c.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_931dc7bfd5a3bb17420d2092811c4b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_931dc7bfd5a3bb17420d2092811c4b0a.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_4e74f86d3b6a14cb73850eb01a177746.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4e74f86d3b6a14cb73850eb01a177746.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_f2e5e1382df12aebd9bda7100c2d2330.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_f2e5e1382df12aebd9bda7100c2d2330.jpg not downloaded yet
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_562a3e01fd90c9bfd9bf80f9b9ebc973.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_6b77aef28a84c3acc2d8fe2f87bb044e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_17f494eb0fcb8d358b005d80c6c750e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_17f494eb0fcb8d358b005d80c6c750e2.jpg not downloaded yet
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_4bb26a2af2a7c3393706cad4b0476666.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4bb26a2af2a7c3393706cad4b0476666.jpg not downloaded yet
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4e74f86d3b6a14cb73850eb01a177746.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_f2e5e1382df12aebd9bda7100c2d2330.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9808b90>
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_562a3e01fd90c9bfd9bf80f9b9ebc973.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_562a3e01fd90c9bfd9bf80f9b9ebc973.jpg saved to cache
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4bb26a2af2a7c3393706cad4b0476666.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_17f494eb0fcb8d358b005d80c6c750e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fd1d0>
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_6b77aef28a84c3acc2d8fe2f87bb044e.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_6b77aef28a84c3acc2d8fe2f87bb044e.jpg saved to cache
2026-03-30 11:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d3a90>
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_4e74f86d3b6a14cb73850eb01a177746.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4e74f86d3b6a14cb73850eb01a177746.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e979c910>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_f2e5e1382df12aebd9bda7100c2d2330.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_f2e5e1382df12aebd9bda7100c2d2330.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_69518621ddd7bc51359f84341cdabce6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_b02378e5b81fe145f206f2c3d3e6bf1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_931dc7bfd5a3bb17420d2092811c4b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0bbc90>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_4bb26a2af2a7c3393706cad4b0476666.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4bb26a2af2a7c3393706cad4b0476666.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98095d0>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_17f494eb0fcb8d358b005d80c6c750e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_17f494eb0fcb8d358b005d80c6c750e2.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981a290>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_69518621ddd7bc51359f84341cdabce6.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_69518621ddd7bc51359f84341cdabce6.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e983b890>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_b02378e5b81fe145f206f2c3d3e6bf1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_b02378e5b81fe145f206f2c3d3e6bf1c.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7f87dac10>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_931dc7bfd5a3bb17420d2092811c4b0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_931dc7bfd5a3bb17420d2092811c4b0a.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e6c90>
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F35%252F7b35584bdd2b4f3de9c2abbe2404794d%252Fpa%252FEU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg saved to cache
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69a93276-0114-5af3-ac84-55e6272a3868
2026-03-30 11:32:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69a93276-0114-5af3-ac84-55e6272a3868, skipping ID generation
2026-03-30 11:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a93276-0114-5af3-ac84-55e6272a3868 with scrape type 1
2026-03-30 11:32:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69a93276-0114-5af3-ac84-55e6272a3868 sending to next pipeline
2026-03-30 11:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69a93276-0114-5af3-ac84-55e6272a3868, identifier: EU06132
2026-03-30 11:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69a93276-0114-5af3-ac84-55e6272a3868 with identifier: EU06132
2026-03-30 11:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69a93276-0114-5af3-ac84-55e6272a3868 with identifier: EU06132
2026-03-30 11:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69a93276-0114-5af3-ac84-55e6272a3868 with identifier: EU06132 to the API
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:26:11Z',
 'fuel_type': 'petrol',
 'id': '69a93276-0114-5af3-ac84-55e6272a3868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU06132',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 166841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_562a3e01fd90c9bfd9bf80f9b9ebc973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_6b77aef28a84c3acc2d8fe2f87bb044e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_69518621ddd7bc51359f84341cdabce6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_1349c12eebca64d7333fcf9b5fe9131e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_b02378e5b81fe145f206f2c3d3e6bf1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_931dc7bfd5a3bb17420d2092811c4b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4e74f86d3b6a14cb73850eb01a177746.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_f2e5e1382df12aebd9bda7100c2d2330.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_17f494eb0fcb8d358b005d80c6c750e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a93276-0114-5af3-ac84-55e6272a3868/69a93276-0114-5af3-ac84-55e6272a3868_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/35/7b35584bdd2b4f3de9c2abbe2404794d/pa/EU06132_4bb26a2af2a7c3393706cad4b0476666.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU06132%27 HTTP/1.1" 200 None
2026-03-30 11:32:34 [auto1.be] INFO: Saving data for EU06132: {'created_time': 1774870354.817408, 'last_price_update_time': 1774870354.81742, 'auction_closing_time': 1774970771.0}
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU06132') HTTP/1.1" 204 0
2026-03-30 11:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:36 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1750 | hits on page: 40
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: HZ18358
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: NY44737
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY44737%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for NY44737: 1
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: NZ74080
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: FV32890
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: PJ15510
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: GP47231
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP47231%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for GP47231: 1
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: RC25453
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: BZ37751
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: FN56971
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: CZ95998
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: AX72969
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX72969%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for AX72969: 1
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: GF16494
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF16494%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for GF16494: 1
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: KP73013
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: MA85279
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: SN67129
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN67129%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for SN67129: 1
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: HV12777
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV12777%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for HV12777: 1
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: PG04506
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: DG79574
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: AP83103
2026-03-30 11:32:36 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-30 11:32:36 [auto1.be] INFO: Scrape type for BU16802: 2
2026-03-30 11:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802
2026-03-30 11:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with scrape type 2
2026-03-30 11:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with scrape type 2
2026-03-30 11:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3, identifier: BU16802
2026-03-30 11:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802
2026-03-30 11:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802
2026-03-30 11:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d89b93a-ed8b-5a64-bf49-157e2abd16c3 with identifier: BU16802 to the API
2026-03-30 11:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:38:23Z',
 'fuel_type': 'diesel',
 'id': '6d89b93a-ed8b-5a64-bf49-157e2abd16c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU16802',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 147833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seller_name': None,
 'title': 'Ford Puma 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-30 11:32:37 [auto1.be] INFO: Saving data for BU16802: {'auction_closing_time': 1774971503.0, 'created_time': 1773136926.063095, 'last_price_update_time': 1774870357.34672}
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU16802') HTTP/1.1" 204 0
2026-03-30 11:32:37 [auto1.be] INFO: Found listing with ID: EN33185
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN33185%27 HTTP/1.1" 200 None
2026-03-30 11:32:37 [auto1.be] INFO: Scrape type for EN33185: 1
2026-03-30 11:32:37 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-30 11:32:37 [auto1.be] INFO: Scrape type for EX12355: 2
2026-03-30 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355
2026-03-30 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with scrape type 2
2026-03-30 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with scrape type 2
2026-03-30 11:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0, identifier: EX12355
2026-03-30 11:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA62329> (referer: https://www.auto1.com/v1/car-details-view/PA62329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355
2026-03-30 11:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355
2026-03-30 11:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0 with identifier: EX12355 to the API
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:56:43Z',
 'fuel_type': 'diesel',
 'id': '2d5e71aa-1a1e-5ec2-8486-d534a1fc9ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX12355',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 137763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': "Kia cee'd 1.4 CRDi Active",
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-30 11:32:37 [auto1.be] INFO: Saving data for EX12355: {'auction_closing_time': 1774972603.0, 'created_time': 1773133955.444827, 'last_price_update_time': 1774870357.907907}
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX12355') HTTP/1.1" 204 0
2026-03-30 11:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:37 [auto1.be] INFO: Found listing with ID: XT04818
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT04818%27 HTTP/1.1" 200 None
2026-03-30 11:32:37 [auto1.be] INFO: Scrape type for XT04818: 2
2026-03-30 11:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a0ae10-a091-56b7-843f-9a4645a984a0 with identifier: XT04818
2026-03-30 11:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a0ae10-a091-56b7-843f-9a4645a984a0 with scrape type 2
2026-03-30 11:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a0ae10-a091-56b7-843f-9a4645a984a0 with scrape type 2
2026-03-30 11:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1a0ae10-a091-56b7-843f-9a4645a984a0, identifier: XT04818
2026-03-30 11:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1a0ae10-a091-56b7-843f-9a4645a984a0 with identifier: XT04818
2026-03-30 11:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1a0ae10-a091-56b7-843f-9a4645a984a0 with identifier: XT04818
2026-03-30 11:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1a0ae10-a091-56b7-843f-9a4645a984a0 with identifier: XT04818 to the API
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:13:26Z',
 'fuel_type': 'diesel',
 'id': 'c1a0ae10-a091-56b7-843f-9a4645a984a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT04818',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 96939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-08',
 'seller_name': None,
 'title': 'Jaguar XF 20d Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2016}
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT04818%27 HTTP/1.1" 200 None
2026-03-30 11:32:38 [auto1.be] INFO: Saving data for XT04818: {'auction_closing_time': 1774970006.0, 'created_time': 1773132414.923829, 'last_price_update_time': 1774870358.38955}
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT04818') HTTP/1.1" 204 0
2026-03-30 11:32:38 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-30 11:32:38 [auto1.be] INFO: Found listing with ID: LZ66906
2026-03-30 11:32:38 [auto1.be] INFO: Found listing with ID: SB08557
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB08557%27 HTTP/1.1" 200 None
2026-03-30 11:32:38 [auto1.be] INFO: Scrape type for SB08557: 2
2026-03-30 11:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08aa386e-3d7f-557a-9fc1-d5d092cd8f76 with identifier: SB08557
2026-03-30 11:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08aa386e-3d7f-557a-9fc1-d5d092cd8f76 with scrape type 2
2026-03-30 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08aa386e-3d7f-557a-9fc1-d5d092cd8f76 with scrape type 2
2026-03-30 11:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 08aa386e-3d7f-557a-9fc1-d5d092cd8f76, identifier: SB08557
2026-03-30 11:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 08aa386e-3d7f-557a-9fc1-d5d092cd8f76 with identifier: SB08557
2026-03-30 11:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 08aa386e-3d7f-557a-9fc1-d5d092cd8f76 with identifier: SB08557
2026-03-30 11:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 08aa386e-3d7f-557a-9fc1-d5d092cd8f76 with identifier: SB08557 to the API
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:01:53Z',
 'fuel_type': 'diesel',
 'id': '08aa386e-3d7f-557a-9fc1-d5d092cd8f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB08557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GL-Klasse',
 'odometer': 267133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GL-Klasse GL 350 CDI 4Matic BlueTec',
 'transmission': 'automatic',
 'trim': '4Matic BlueTec',
 'year': 2014}
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB08557%27 HTTP/1.1" 200 None
2026-03-30 11:32:38 [auto1.be] INFO: Saving data for SB08557: {'auction_closing_time': 1774969313.0, 'created_time': 1773135536.992091, 'last_price_update_time': 1774870358.884943}
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB08557') HTTP/1.1" 204 0
2026-03-30 11:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 062cc19f-5ceb-536c-9daa-2eb49b706c88 with identifier: PA62329
2026-03-30 11:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062cc19f-5ceb-536c-9daa-2eb49b706c88 with scrape type 1
2026-03-30 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_ae579c156fba6835f8c9030e17c16db8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_ae579c156fba6835f8c9030e17c16db8.jpg not downloaded yet
2026-03-30 11:32:38 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-30 11:32:38 [auto1.be] INFO: Scrape type for VC37293: 2
2026-03-30 11:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293
2026-03-30 11:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3381d5b-650c-5629-a34f-8ec551b33685 with scrape type 2
2026-03-30 11:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3381d5b-650c-5629-a34f-8ec551b33685 with scrape type 2
2026-03-30 11:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3381d5b-650c-5629-a34f-8ec551b33685, identifier: VC37293
2026-03-30 11:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293
2026-03-30 11:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293
2026-03-30 11:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3381d5b-650c-5629-a34f-8ec551b33685 with identifier: VC37293 to the API
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:19:58Z',
 'fuel_type': 'diesel',
 'id': 'd3381d5b-650c-5629-a34f-8ec551b33685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC37293',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 187062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Saving data for VC37293: {'auction_closing_time': 1774970398.0, 'created_time': 1773233667.11411, 'last_price_update_time': 1774870359.3281}
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VC37293') HTTP/1.1" 204 0
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_886372c58c0afbc3a93abc742412b11b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_886372c58c0afbc3a93abc742412b11b.jpg not downloaded yet
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: VM73638
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM73638%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Scrape type for VM73638: 2
2026-03-30 11:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a86e33-77ac-5a63-b109-dc2d58cc196c with identifier: VM73638
2026-03-30 11:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a86e33-77ac-5a63-b109-dc2d58cc196c with scrape type 2
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a86e33-77ac-5a63-b109-dc2d58cc196c with scrape type 2
2026-03-30 11:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03a86e33-77ac-5a63-b109-dc2d58cc196c, identifier: VM73638
2026-03-30 11:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03a86e33-77ac-5a63-b109-dc2d58cc196c with identifier: VM73638
2026-03-30 11:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03a86e33-77ac-5a63-b109-dc2d58cc196c with identifier: VM73638
2026-03-30 11:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03a86e33-77ac-5a63-b109-dc2d58cc196c with identifier: VM73638 to the API
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:51:11Z',
 'fuel_type': 'diesel',
 'id': '03a86e33-77ac-5a63-b109-dc2d58cc196c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM73638',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 262037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM73638%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Saving data for VM73638: {'auction_closing_time': 1774972271.0, 'created_time': 1773133532.593542, 'last_price_update_time': 1774870359.780016}
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM73638') HTTP/1.1" 204 0
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_b1be8bc48012c09d67b3c857443bb255.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_b1be8bc48012c09d67b3c857443bb255.jpg not downloaded yet
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: NN23833
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: LL36381
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL36381%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Scrape type for LL36381: 1
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_0f594084becf81de362f4b6c5524c063.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_0f594084becf81de362f4b6c5524c063.jpg not downloaded yet
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: ML14183
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: TY10395
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10395%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Scrape type for TY10395: 1
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_22f4f92e29607a93c927c6bfa1c4af1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_22f4f92e29607a93c927c6bfa1c4af1f.jpg not downloaded yet
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: DR07061
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: VW96502
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW96502%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Scrape type for VW96502: 1
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_9748a8670aebdf16fbd0dcf607aada9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_9748a8670aebdf16fbd0dcf607aada9b.jpg not downloaded yet
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: DF90944
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: VN70720
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: XD51525
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD51525%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [auto1.be] INFO: Scrape type for XD51525: 1
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_abc13e3efea78877548911e1c86b888b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_abc13e3efea78877548911e1c86b888b.jpg not downloaded yet
2026-03-30 11:32:39 [auto1.be] INFO: Found listing with ID: GW35793
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_883c82f064a51efc937ad605b215761b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_883c82f064a51efc937ad605b215761b.jpg not downloaded yet
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_e84efe35bb49c6d3ab74cc102024e9ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_e84efe35bb49c6d3ab74cc102024e9ab.jpg not downloaded yet
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_d60aa5815580d083dcec87c567ffd3d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_d60aa5815580d083dcec87c567ffd3d5.jpg not downloaded yet
2026-03-30 11:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG12556> (referer: https://www.auto1.com/v1/car-details-view/SG12556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_d60aa5815580d083dcec87c567ffd3d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54db686-76e8-50e3-989b-8367b9515017 with identifier: SG12556
2026-03-30 11:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54db686-76e8-50e3-989b-8367b9515017 with scrape type 1
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_fb19b392d0fbcd37177c65c02cdd5ce8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_fb19b392d0fbcd37177c65c02cdd5ce8.jpg not downloaded yet
2026-03-30 11:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE72879> (referer: https://www.auto1.com/v1/car-details-view/GE72879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_80395e94bb4cc117a026e84d6835644b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_80395e94bb4cc117a026e84d6835644b.jpg not downloaded yet
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_eeaf9971cb396b86a2df105970e15baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_eeaf9971cb396b86a2df105970e15baf.jpg not downloaded yet
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_e8b7ea8fd1d99ff25f6feb5d5ca9443e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_e8b7ea8fd1d99ff25f6feb5d5ca9443e.jpg not downloaded yet
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_6bb1ff5024b28b4c6faf4b492aa8ccfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_6bb1ff5024b28b4c6faf4b492aa8ccfd.jpg not downloaded yet
2026-03-30 11:32:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9841ad0>
2026-03-30 11:32:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_d60aa5815580d083dcec87c567ffd3d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_d60aa5815580d083dcec87c567ffd3d5.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_082700b8dce1338cfe6652e8da3f2b28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_082700b8dce1338cfe6652e8da3f2b28.jpg not downloaded yet
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_fb19b392d0fbcd37177c65c02cdd5ce8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_985de355601b704ca95268a5fc2166f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_985de355601b704ca95268a5fc2166f4.jpg not downloaded yet
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_e84efe35bb49c6d3ab74cc102024e9ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676f8466-f72b-5023-8a2f-9ed25ef89579 with identifier: GE72879
2026-03-30 11:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676f8466-f72b-5023-8a2f-9ed25ef89579 with scrape type 1
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_93d53013597499dffaf8524bb725c8c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_93d53013597499dffaf8524bb725c8c0.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_9f9e263446991c0b4538f7c57c015adb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_9f9e263446991c0b4538f7c57c015adb.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_f869e8690954c2f96e558401c6a313ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_f869e8690954c2f96e558401c6a313ef.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_424c4c9006e1517475a03ac3c0ddb576.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_424c4c9006e1517475a03ac3c0ddb576.jpg not downloaded yet
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9853c10>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_fb19b392d0fbcd37177c65c02cdd5ce8.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_fb19b392d0fbcd37177c65c02cdd5ce8.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e0710>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_e84efe35bb49c6d3ab74cc102024e9ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_e84efe35bb49c6d3ab74cc102024e9ab.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_73cbceddea6246f06b90294bcc7cc788.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_73cbceddea6246f06b90294bcc7cc788.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_1df2bf2a5a260160fbdac70ca55f3b10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_1df2bf2a5a260160fbdac70ca55f3b10.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_6ce5e65a9bb0dc02b70fd0f082bb3d60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ce5e65a9bb0dc02b70fd0f082bb3d60.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_eebd491c5f9c9f3e9e7c69da4b73b5e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_eebd491c5f9c9f3e9e7c69da4b73b5e4.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_75dad1070c883de90531e5999d4eab8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_75dad1070c883de90531e5999d4eab8c.jpg not downloaded yet
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_082700b8dce1338cfe6652e8da3f2b28.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_34c13750bc8cb5bafa55cb277586b362.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_34c13750bc8cb5bafa55cb277586b362.jpg not downloaded yet
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_6bb1ff5024b28b4c6faf4b492aa8ccfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_6ae375215c878ef46ff843085a89bdee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ae375215c878ef46ff843085a89bdee.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_7446d7a36e49323d66578f72baceeff6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7446d7a36e49323d66578f72baceeff6.jpg not downloaded yet
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_7c283ce2621010955b4f4fd7a871c0c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7c283ce2621010955b4f4fd7a871c0c1.jpg not downloaded yet
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12c4d0>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_082700b8dce1338cfe6652e8da3f2b28.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_082700b8dce1338cfe6652e8da3f2b28.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_34c13750bc8cb5bafa55cb277586b362.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea132f10>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_6bb1ff5024b28b4c6faf4b492aa8ccfd.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_6bb1ff5024b28b4c6faf4b492aa8ccfd.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9884490>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_34c13750bc8cb5bafa55cb277586b362.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_34c13750bc8cb5bafa55cb277586b362.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_75dad1070c883de90531e5999d4eab8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7c283ce2621010955b4f4fd7a871c0c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7446d7a36e49323d66578f72baceeff6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec78d910>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_75dad1070c883de90531e5999d4eab8c.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_75dad1070c883de90531e5999d4eab8c.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97f9e90>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_7c283ce2621010955b4f4fd7a871c0c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7c283ce2621010955b4f4fd7a871c0c1.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b1690>
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_7446d7a36e49323d66578f72baceeff6.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7446d7a36e49323d66578f72baceeff6.jpg saved to cache
2026-03-30 11:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ae375215c878ef46ff843085a89bdee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_eebd491c5f9c9f3e9e7c69da4b73b5e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ce5e65a9bb0dc02b70fd0f082bb3d60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fb210>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_6ae375215c878ef46ff843085a89bdee.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ae375215c878ef46ff843085a89bdee.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC31408> (referer: https://www.auto1.com/v1/car-details-view/CC31408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9823450>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_eebd491c5f9c9f3e9e7c69da4b73b5e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_eebd491c5f9c9f3e9e7c69da4b73b5e4.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9852fd0>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_6ce5e65a9bb0dc02b70fd0f082bb3d60.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ce5e65a9bb0dc02b70fd0f082bb3d60.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_1df2bf2a5a260160fbdac70ca55f3b10.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_424c4c9006e1517475a03ac3c0ddb576.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d8c908b-6e40-5329-a881-a8da764fbd5c with identifier: CC31408
2026-03-30 11:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8c908b-6e40-5329-a881-a8da764fbd5c with scrape type 1
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_be3075d43682661b32ac696adc214c26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_be3075d43682661b32ac696adc214c26.jpg not downloaded yet
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_50dffc2d841311279666b2532c0ce531.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_50dffc2d841311279666b2532c0ce531.jpg not downloaded yet
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_73cbceddea6246f06b90294bcc7cc788.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_953afe5b21ea2c1ce0550b320f92236e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_953afe5b21ea2c1ce0550b320f92236e.jpg not downloaded yet
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_9f9e263446991c0b4538f7c57c015adb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_51e58e76e7cd8fd828df61d7b4c57c9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_51e58e76e7cd8fd828df61d7b4c57c9e.jpg not downloaded yet
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_74b4b674e9996feba268d763b6f9e7d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_74b4b674e9996feba268d763b6f9e7d1.jpg not downloaded yet
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_c543385687180ac2e5738625a8228a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_c543385687180ac2e5738625a8228a2f.jpg not downloaded yet
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea215cd0>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_1df2bf2a5a260160fbdac70ca55f3b10.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_1df2bf2a5a260160fbdac70ca55f3b10.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_43e70e11c900c2d888351acac67aeeb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_43e70e11c900c2d888351acac67aeeb4.jpg not downloaded yet
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_be3075d43682661b32ac696adc214c26.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0eee50>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_424c4c9006e1517475a03ac3c0ddb576.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_424c4c9006e1517475a03ac3c0ddb576.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_5baf65101d33a0f657a1c79c3cd05861.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_5baf65101d33a0f657a1c79c3cd05861.jpg not downloaded yet
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_93d7c2d27bdc35b17ea2af3d5119fbe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_93d7c2d27bdc35b17ea2af3d5119fbe6.jpg not downloaded yet
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0be6d0>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_73cbceddea6246f06b90294bcc7cc788.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_73cbceddea6246f06b90294bcc7cc788.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0f6fd0>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_9f9e263446991c0b4538f7c57c015adb.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_9f9e263446991c0b4538f7c57c015adb.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_50dffc2d841311279666b2532c0ce531.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_bb7fa9041c9685e20a4c7b4a47ff3a5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_bb7fa9041c9685e20a4c7b4a47ff3a5b.jpg not downloaded yet
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_f869e8690954c2f96e558401c6a313ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_c543385687180ac2e5738625a8228a2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b9c10>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_be3075d43682661b32ac696adc214c26.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_be3075d43682661b32ac696adc214c26.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_bb7fa9041c9685e20a4c7b4a47ff3a5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaee8250>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_50dffc2d841311279666b2532c0ce531.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_50dffc2d841311279666b2532c0ce531.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9885650>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_f869e8690954c2f96e558401c6a313ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_f869e8690954c2f96e558401c6a313ef.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0be210>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_c543385687180ac2e5738625a8228a2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_c543385687180ac2e5738625a8228a2f.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_93d7c2d27bdc35b17ea2af3d5119fbe6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec78d910>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_bb7fa9041c9685e20a4c7b4a47ff3a5b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_bb7fa9041c9685e20a4c7b4a47ff3a5b.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_5baf65101d33a0f657a1c79c3cd05861.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_43e70e11c900c2d888351acac67aeeb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec3b2e10>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_93d7c2d27bdc35b17ea2af3d5119fbe6.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_93d7c2d27bdc35b17ea2af3d5119fbe6.jpg saved to cache
2026-03-30 11:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_953afe5b21ea2c1ce0550b320f92236e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9877090>
2026-03-30 11:32:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_5baf65101d33a0f657a1c79c3cd05861.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_5baf65101d33a0f657a1c79c3cd05861.jpg saved to cache
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea285890>
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_43e70e11c900c2d888351acac67aeeb4.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_43e70e11c900c2d888351acac67aeeb4.jpg saved to cache
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_51e58e76e7cd8fd828df61d7b4c57c9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_74b4b674e9996feba268d763b6f9e7d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea25b550>
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_953afe5b21ea2c1ce0550b320f92236e.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_953afe5b21ea2c1ce0550b320f92236e.jpg saved to cache
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_93d53013597499dffaf8524bb725c8c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_eeaf9971cb396b86a2df105970e15baf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e0ed0>
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_51e58e76e7cd8fd828df61d7b4c57c9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_51e58e76e7cd8fd828df61d7b4c57c9e.jpg saved to cache
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98457d0>
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fbb%252Fbbbba8fcb24ec1655a751746dd7b5cd5%252Fpa%252FCC31408_74b4b674e9996feba268d763b6f9e7d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_74b4b674e9996feba268d763b6f9e7d1.jpg saved to cache
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d8c908b-6e40-5329-a881-a8da764fbd5c
2026-03-30 11:32:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d8c908b-6e40-5329-a881-a8da764fbd5c, skipping ID generation
2026-03-30 11:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8c908b-6e40-5329-a881-a8da764fbd5c with scrape type 1
2026-03-30 11:32:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d8c908b-6e40-5329-a881-a8da764fbd5c sending to next pipeline
2026-03-30 11:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d8c908b-6e40-5329-a881-a8da764fbd5c, identifier: CC31408
2026-03-30 11:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d8c908b-6e40-5329-a881-a8da764fbd5c with identifier: CC31408
2026-03-30 11:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d8c908b-6e40-5329-a881-a8da764fbd5c with identifier: CC31408
2026-03-30 11:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d8c908b-6e40-5329-a881-a8da764fbd5c with identifier: CC31408 to the API
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_74b4b674e9996feba268d763b6f9e7d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:20Z',
 'fuel_type': 'diesel',
 'id': '4d8c908b-6e40-5329-a881-a8da764fbd5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC31408',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 101118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_be3075d43682661b32ac696adc214c26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_50dffc2d841311279666b2532c0ce531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_953afe5b21ea2c1ce0550b320f92236e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_51e58e76e7cd8fd828df61d7b4c57c9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_74b4b674e9996feba268d763b6f9e7d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_c543385687180ac2e5738625a8228a2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_43e70e11c900c2d888351acac67aeeb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_5baf65101d33a0f657a1c79c3cd05861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_93d7c2d27bdc35b17ea2af3d5119fbe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8c908b-6e40-5329-a881-a8da764fbd5c/4d8c908b-6e40-5329-a881-a8da764fbd5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/bb/bbbba8fcb24ec1655a751746dd7b5cd5/pa/CC31408_bb7fa9041c9685e20a4c7b4a47ff3a5b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC31408%27 HTTP/1.1" 200 None
2026-03-30 11:32:43 [auto1.be] INFO: Saving data for CC31408: {'created_time': 1774870363.989282, 'last_price_update_time': 1774870363.989295, 'auction_closing_time': 1774969340.0}
2026-03-30 11:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC31408') HTTP/1.1" 204 0
2026-03-30 11:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_985de355601b704ca95268a5fc2166f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:32:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:32:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:32:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:32:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9877e10>
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F93%252F9f930b387afa19d848a9be9c6ea632b8%252Fpa%252FGE72879_93d53013597499dffaf8524bb725c8c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_93d53013597499dffaf8524bb725c8c0.jpg saved to cache
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 676f8466-f72b-5023-8a2f-9ed25ef89579
2026-03-30 11:32:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 676f8466-f72b-5023-8a2f-9ed25ef89579, skipping ID generation
2026-03-30 11:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676f8466-f72b-5023-8a2f-9ed25ef89579 with scrape type 1
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 676f8466-f72b-5023-8a2f-9ed25ef89579 sending to next pipeline
2026-03-30 11:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 676f8466-f72b-5023-8a2f-9ed25ef89579, identifier: GE72879
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e7310>
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_eeaf9971cb396b86a2df105970e15baf.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_eeaf9971cb396b86a2df105970e15baf.jpg saved to cache
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_e8b7ea8fd1d99ff25f6feb5d5ca9443e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_80395e94bb4cc117a026e84d6835644b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 676f8466-f72b-5023-8a2f-9ed25ef89579 with identifier: GE72879
2026-03-30 11:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 676f8466-f72b-5023-8a2f-9ed25ef89579 with identifier: GE72879
2026-03-30 11:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 676f8466-f72b-5023-8a2f-9ed25ef89579 with identifier: GE72879 to the API
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_93d53013597499dffaf8524bb725c8c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:02Z',
 'fuel_type': 'petrol',
 'id': '676f8466-f72b-5023-8a2f-9ed25ef89579',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE72879',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 227403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 969993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_93d53013597499dffaf8524bb725c8c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_f869e8690954c2f96e558401c6a313ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_73cbceddea6246f06b90294bcc7cc788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ce5e65a9bb0dc02b70fd0f082bb3d60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_eebd491c5f9c9f3e9e7c69da4b73b5e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_75dad1070c883de90531e5999d4eab8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_34c13750bc8cb5bafa55cb277586b362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_6ae375215c878ef46ff843085a89bdee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7446d7a36e49323d66578f72baceeff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_676f8466-f72b-5023-8a2f-9ed25ef89579/676f8466-f72b-5023-8a2f-9ed25ef89579_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/93/9f930b387afa19d848a9be9c6ea632b8/pa/GE72879_7c283ce2621010955b4f4fd7a871c0c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2012}
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE72879%27 HTTP/1.1" 200 None
2026-03-30 11:32:44 [auto1.be] INFO: Saving data for GE72879: {'created_time': 1774870364.849728, 'last_price_update_time': 1774870364.849742, 'auction_closing_time': 1774969322.0}
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GE72879') HTTP/1.1" 204 0
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9831150>
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_985de355601b704ca95268a5fc2166f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_985de355601b704ca95268a5fc2166f4.jpg saved to cache
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c0ad0>
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_e8b7ea8fd1d99ff25f6feb5d5ca9443e.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_e8b7ea8fd1d99ff25f6feb5d5ca9443e.jpg saved to cache
2026-03-30 11:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea09df10>
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F73%252F38733bab56d9d18d083d0cb7d0212876%252Fpa%252FSG12556_80395e94bb4cc117a026e84d6835644b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_80395e94bb4cc117a026e84d6835644b.jpg saved to cache
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a54db686-76e8-50e3-989b-8367b9515017
2026-03-30 11:32:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a54db686-76e8-50e3-989b-8367b9515017, skipping ID generation
2026-03-30 11:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54db686-76e8-50e3-989b-8367b9515017 with scrape type 1
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54db686-76e8-50e3-989b-8367b9515017 sending to next pipeline
2026-03-30 11:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a54db686-76e8-50e3-989b-8367b9515017, identifier: SG12556
2026-03-30 11:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a54db686-76e8-50e3-989b-8367b9515017 with identifier: SG12556
2026-03-30 11:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a54db686-76e8-50e3-989b-8367b9515017 with identifier: SG12556
2026-03-30 11:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a54db686-76e8-50e3-989b-8367b9515017 with identifier: SG12556 to the API
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_80395e94bb4cc117a026e84d6835644b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:27:13Z',
 'fuel_type': 'petrol',
 'id': 'a54db686-76e8-50e3-989b-8367b9515017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG12556',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 122624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_fb19b392d0fbcd37177c65c02cdd5ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_80395e94bb4cc117a026e84d6835644b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 143924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_eeaf9971cb396b86a2df105970e15baf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_e8b7ea8fd1d99ff25f6feb5d5ca9443e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_6bb1ff5024b28b4c6faf4b492aa8ccfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_082700b8dce1338cfe6652e8da3f2b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_985de355601b704ca95268a5fc2166f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_9f9e263446991c0b4538f7c57c015adb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_424c4c9006e1517475a03ac3c0ddb576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54db686-76e8-50e3-989b-8367b9515017/a54db686-76e8-50e3-989b-8367b9515017_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/73/38733bab56d9d18d083d0cb7d0212876/pa/SG12556_1df2bf2a5a260160fbdac70ca55f3b10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2012}
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG12556%27 HTTP/1.1" 200 None
2026-03-30 11:32:45 [auto1.be] INFO: Saving data for SG12556: {'created_time': 1774870365.533584, 'last_price_update_time': 1774870365.533597, 'auction_closing_time': 1774970833.0}
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG12556') HTTP/1.1" 204 0
2026-03-30 11:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_883c82f064a51efc937ad605b215761b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_abc13e3efea78877548911e1c86b888b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_9748a8670aebdf16fbd0dcf607aada9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec0629d0>
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_883c82f064a51efc937ad605b215761b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_883c82f064a51efc937ad605b215761b.jpg saved to cache
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e979f390>
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_abc13e3efea78877548911e1c86b888b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_abc13e3efea78877548911e1c86b888b.jpg saved to cache
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9863ad0>
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_9748a8670aebdf16fbd0dcf607aada9b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_9748a8670aebdf16fbd0dcf607aada9b.jpg saved to cache
2026-03-30 11:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_22f4f92e29607a93c927c6bfa1c4af1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9868210>
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_22f4f92e29607a93c927c6bfa1c4af1f.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_22f4f92e29607a93c927c6bfa1c4af1f.jpg saved to cache
2026-03-30 11:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY85550> (referer: https://www.auto1.com/v1/car-details-view/GY85550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4410ab50-b3ae-5365-bee6-516ffe7d4a4d with identifier: GY85550
2026-03-30 11:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d with scrape type 1
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_dcfe2cf9435de997d18526d28c64e8ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_dcfe2cf9435de997d18526d28c64e8ef.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_4d12d2bccab84634f988cd4c3bc144d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_4d12d2bccab84634f988cd4c3bc144d3.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_88d058c276349bbb89c3f538c75e7148.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_88d058c276349bbb89c3f538c75e7148.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_ecbdd6180209848a630b6ab55a39d8a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ecbdd6180209848a630b6ab55a39d8a6.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_2894776ead3fc4cbfdc9c60ef0473679.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2894776ead3fc4cbfdc9c60ef0473679.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_b01203fd4d46d71eccc909dfc54a963c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_b01203fd4d46d71eccc909dfc54a963c.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_ac41f50a324ca2bf930576f6f296386b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ac41f50a324ca2bf930576f6f296386b.jpg not downloaded yet
2026-03-30 11:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_0f594084becf81de362f4b6c5524c063.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_776e600091d955eba9ef192007faec1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_776e600091d955eba9ef192007faec1b.jpg not downloaded yet
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_2cd747c91a8d407608939622e3b4a5e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2cd747c91a8d407608939622e3b4a5e3.jpg not downloaded yet
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d0110>
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_0f594084becf81de362f4b6c5524c063.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_0f594084becf81de362f4b6c5524c063.jpg saved to cache
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ac41f50a324ca2bf930576f6f296386b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1e0c10>
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_ac41f50a324ca2bf930576f6f296386b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ac41f50a324ca2bf930576f6f296386b.jpg saved to cache
2026-03-30 11:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2cd747c91a8d407608939622e3b4a5e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12c6d0>
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_2cd747c91a8d407608939622e3b4a5e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2cd747c91a8d407608939622e3b4a5e3.jpg saved to cache
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_776e600091d955eba9ef192007faec1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_b01203fd4d46d71eccc909dfc54a963c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c13d0>
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_776e600091d955eba9ef192007faec1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_776e600091d955eba9ef192007faec1b.jpg saved to cache
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea102950>
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_b01203fd4d46d71eccc909dfc54a963c.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_b01203fd4d46d71eccc909dfc54a963c.jpg saved to cache
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2894776ead3fc4cbfdc9c60ef0473679.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_88d058c276349bbb89c3f538c75e7148.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e58d0>
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_2894776ead3fc4cbfdc9c60ef0473679.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2894776ead3fc4cbfdc9c60ef0473679.jpg saved to cache
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:52 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1751 | hits on page: 40
2026-03-30 11:32:52 [auto1.be] INFO: Found listing with ID: GW35793
2026-03-30 11:32:52 [auto1.be] INFO: Found listing with ID: GE39659
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE39659%27 HTTP/1.1" 200 None
2026-03-30 11:32:52 [auto1.be] INFO: Scrape type for GE39659: 2
2026-03-30 11:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db0b2067-84f8-55ca-83fa-b25637638316 with identifier: GE39659
2026-03-30 11:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0b2067-84f8-55ca-83fa-b25637638316 with scrape type 2
2026-03-30 11:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db0b2067-84f8-55ca-83fa-b25637638316 with scrape type 2
2026-03-30 11:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db0b2067-84f8-55ca-83fa-b25637638316, identifier: GE39659
2026-03-30 11:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db0b2067-84f8-55ca-83fa-b25637638316 with identifier: GE39659
2026-03-30 11:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db0b2067-84f8-55ca-83fa-b25637638316 with identifier: GE39659
2026-03-30 11:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db0b2067-84f8-55ca-83fa-b25637638316 with identifier: GE39659 to the API
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:46:15Z',
 'fuel_type': 'petrol',
 'id': 'db0b2067-84f8-55ca-83fa-b25637638316',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE39659',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 222228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 450 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE39659%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Saving data for GE39659: {'auction_closing_time': 1774971975.0, 'created_time': 1773660993.910677, 'last_price_update_time': 1774870373.097406}
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GE39659') HTTP/1.1" 204 0
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: HU41998
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU41998%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for HU41998: 1
2026-03-30 11:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ecbdd6180209848a630b6ab55a39d8a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_4d12d2bccab84634f988cd4c3bc144d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9823850>
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_88d058c276349bbb89c3f538c75e7148.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_88d058c276349bbb89c3f538c75e7148.jpg saved to cache
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: EX80528
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: UD84519
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: YS23532
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23532%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for YS23532: 1
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: XP52428
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: DC49978
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC49978%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for DC49978: 1
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: SM03670
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM03670%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for SM03670: 2
2026-03-30 11:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9 with identifier: SM03670
2026-03-30 11:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9 with scrape type 2
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9 with scrape type 2
2026-03-30 11:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9, identifier: SM03670
2026-03-30 11:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9 with identifier: SM03670
2026-03-30 11:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9 with identifier: SM03670
2026-03-30 11:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9 with identifier: SM03670 to the API
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:41:42Z',
 'fuel_type': 'diesel',
 'id': '7e0e9f7d-0bb0-51ab-88e8-2000d5d0dec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM03670',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 201865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-18',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM03670%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Saving data for SM03670: {'auction_closing_time': 1774971702.0, 'created_time': 1773132061.336406, 'last_price_update_time': 1774870373.678643}
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SM03670') HTTP/1.1" 204 0
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: KJ54388
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: CR86629
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: MZ25594
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: AK26681
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: YV94819
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV94819%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for YV94819: 1
2026-03-30 11:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_dcfe2cf9435de997d18526d28c64e8ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9845610>
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_ecbdd6180209848a630b6ab55a39d8a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ecbdd6180209848a630b6ab55a39d8a6.jpg saved to cache
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a4490>
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_4d12d2bccab84634f988cd4c3bc144d3.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_4d12d2bccab84634f988cd4c3bc144d3.jpg saved to cache
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: EX41608
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX41608%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for EX41608: 1
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: AN71185
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN71185%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for AN71185: 1
2026-03-30 11:32:53 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-30 11:32:53 [auto1.be] INFO: Scrape type for BJ84732: 2
2026-03-30 11:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732
2026-03-30 11:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abc7fd79-5e19-5fb5-b88b-51b59a75c102 with scrape type 2
2026-03-30 11:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abc7fd79-5e19-5fb5-b88b-51b59a75c102 with scrape type 2
2026-03-30 11:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abc7fd79-5e19-5fb5-b88b-51b59a75c102, identifier: BJ84732
2026-03-30 11:32:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:32:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d1dd0>
2026-03-30 11:32:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:32:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_dcfe2cf9435de997d18526d28c64e8ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_dcfe2cf9435de997d18526d28c64e8ef.jpg saved to cache
2026-03-30 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732
2026-03-30 11:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732
2026-03-30 11:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abc7fd79-5e19-5fb5-b88b-51b59a75c102 with identifier: BJ84732 to the API
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:10:09Z',
 'fuel_type': 'diesel',
 'id': 'abc7fd79-5e19-5fb5-b88b-51b59a75c102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ84732',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 198406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-28',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 1.6 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2013}
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-30 11:32:54 [auto1.be] INFO: Saving data for BJ84732: {'auction_closing_time': 1774969809.0, 'created_time': 1774513851.388167, 'last_price_update_time': 1774870374.425951}
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ84732') HTTP/1.1" 204 0
2026-03-30 11:32:54 [auto1.be] INFO: Found listing with ID: PK57553
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK57553%27 HTTP/1.1" 200 None
2026-03-30 11:32:54 [auto1.be] INFO: Scrape type for PK57553: 1
2026-03-30 11:32:54 [auto1.be] INFO: Found listing with ID: TW44270
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW44270%27 HTTP/1.1" 200 None
2026-03-30 11:32:54 [auto1.be] INFO: Scrape type for TW44270: 2
2026-03-30 11:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5caa272c-1547-58bc-803a-3eec9ff431e4 with identifier: TW44270
2026-03-30 11:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5caa272c-1547-58bc-803a-3eec9ff431e4 with scrape type 2
2026-03-30 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5caa272c-1547-58bc-803a-3eec9ff431e4 with scrape type 2
2026-03-30 11:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5caa272c-1547-58bc-803a-3eec9ff431e4, identifier: TW44270
2026-03-30 11:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5caa272c-1547-58bc-803a-3eec9ff431e4 with identifier: TW44270
2026-03-30 11:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5caa272c-1547-58bc-803a-3eec9ff431e4 with identifier: TW44270
2026-03-30 11:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5caa272c-1547-58bc-803a-3eec9ff431e4 with identifier: TW44270 to the API
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:35:27Z',
 'fuel_type': 'diesel',
 'id': '5caa272c-1547-58bc-803a-3eec9ff431e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44270',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 38364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-02',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW44270%27 HTTP/1.1" 200 None
2026-03-30 11:32:54 [auto1.be] INFO: Saving data for TW44270: {'auction_closing_time': 1774971327.0, 'created_time': 1773137800.269716, 'last_price_update_time': 1774870374.872739}
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW44270') HTTP/1.1" 204 0
2026-03-30 11:32:54 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-30 11:32:54 [auto1.be] INFO: Scrape type for BD22160: 2
2026-03-30 11:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-30 11:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07fa1a96-c02b-5f32-ad25-b54f089197a8 with scrape type 2
2026-03-30 11:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07fa1a96-c02b-5f32-ad25-b54f089197a8 with scrape type 2
2026-03-30 11:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07fa1a96-c02b-5f32-ad25-b54f089197a8, identifier: BD22160
2026-03-30 11:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:32:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160
2026-03-30 11:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07fa1a96-c02b-5f32-ad25-b54f089197a8 with identifier: BD22160 to the API
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:59:52Z',
 'fuel_type': 'hybrid',
 'id': '07fa1a96-c02b-5f32-ad25-b54f089197a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD22160',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 81628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Audi A7 Sportback 55 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-30 11:32:55 [auto1.be] INFO: Saving data for BD22160: {'auction_closing_time': 1774972792.0, 'created_time': 1774352261.344766, 'last_price_update_time': 1774870375.509444}
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD22160') HTTP/1.1" 204 0
2026-03-30 11:32:55 [auto1.be] INFO: Found listing with ID: HH57000
2026-03-30 11:32:55 [auto1.be] INFO: Found listing with ID: FG64807
2026-03-30 11:32:55 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-30 11:32:55 [auto1.be] INFO: Found listing with ID: KU43333
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU43333%27 HTTP/1.1" 200 None
2026-03-30 11:32:55 [auto1.be] INFO: Scrape type for KU43333: 2
2026-03-30 11:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3378208-142f-5c90-b424-58a0ed314469 with identifier: KU43333
2026-03-30 11:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3378208-142f-5c90-b424-58a0ed314469 with scrape type 2
2026-03-30 11:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3378208-142f-5c90-b424-58a0ed314469 with scrape type 2
2026-03-30 11:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3378208-142f-5c90-b424-58a0ed314469, identifier: KU43333
2026-03-30 11:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3378208-142f-5c90-b424-58a0ed314469 with identifier: KU43333
2026-03-30 11:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3378208-142f-5c90-b424-58a0ed314469 with identifier: KU43333
2026-03-30 11:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3378208-142f-5c90-b424-58a0ed314469 with identifier: KU43333 to the API
2026-03-30 11:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:45:12Z',
 'fuel_type': 'petrol',
 'id': 'e3378208-142f-5c90-b424-58a0ed314469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU43333',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 114778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU43333%27 HTTP/1.1" 200 None
2026-03-30 11:32:56 [auto1.be] INFO: Saving data for KU43333: {'auction_closing_time': 1774971912.0, 'created_time': 1773137736.600813, 'last_price_update_time': 1774870376.366775}
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU43333') HTTP/1.1" 204 0
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: JL68668
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: KV35252
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV35252%27 HTTP/1.1" 200 None
2026-03-30 11:32:56 [auto1.be] INFO: Scrape type for KV35252: 1
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: XL30986
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL30986%27 HTTP/1.1" 200 None
2026-03-30 11:32:56 [auto1.be] INFO: Scrape type for XL30986: 1
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: CB18656
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB18656%27 HTTP/1.1" 200 None
2026-03-30 11:32:56 [auto1.be] INFO: Scrape type for CB18656: 1
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: XT98114
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT98114%27 HTTP/1.1" 200 None
2026-03-30 11:32:56 [auto1.be] INFO: Scrape type for XT98114: 1
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: HT72624
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT72624%27 HTTP/1.1" 200 None
2026-03-30 11:32:56 [auto1.be] INFO: Scrape type for HT72624: 1
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: PV43635
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: UW31030
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: TG84892
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: YD71561
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: KP37607
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-30 11:32:56 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-30 11:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV19532> (referer: https://www.auto1.com/v1/car-details-view/YV19532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6 with identifier: YV19532
2026-03-30 11:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6 with scrape type 1
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F0b%252Fd30b7b24cd070ddddf578bb2440f3794%252Fpa%252FYV19532_26985140ddd5a28080fa22a4fb89b312.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_26985140ddd5a28080fa22a4fb89b312.jpg already downloaded
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F0b%252Fd30b7b24cd070ddddf578bb2440f3794%252Fpa%252FYV19532_4209308f252f516f3d10a49cbe7ea60d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_4209308f252f516f3d10a49cbe7ea60d.jpg already downloaded
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F0b%252Fd30b7b24cd070ddddf578bb2440f3794%252Fpa%252FYV19532_ebcc280f4a9fb3aac9326e41db9209f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_ebcc280f4a9fb3aac9326e41db9209f0.jpg already downloaded
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F0b%252Fd30b7b24cd070ddddf578bb2440f3794%252Fpa%252FYV19532_920a55529ae72105a6d04c1428b2f148.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_920a55529ae72105a6d04c1428b2f148.jpg already downloaded
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F0b%252Fd30b7b24cd070ddddf578bb2440f3794%252Fpa%252FYV19532_9de5f88ab80450810643c92d951508d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_9de5f88ab80450810643c92d951508d9.jpg already downloaded
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F0b%252Fd30b7b24cd070ddddf578bb2440f3794%252Fpa%252FYV19532_feeab812e960790f21cf7a7b8ebad748.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_feeab812e960790f21cf7a7b8ebad748.jpg already downloaded
2026-03-30 11:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6, identifier: YV19532
2026-03-30 11:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6 with identifier: YV19532
2026-03-30 11:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6 with identifier: YV19532
2026-03-30 11:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6 with identifier: YV19532 to the API
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV19532>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:16:00Z',
 'fuel_type': 'petrol',
 'id': 'e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV19532',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 183143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_26985140ddd5a28080fa22a4fb89b312.jpg',
                'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_4209308f252f516f3d10a49cbe7ea60d.jpg',
                'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_ebcc280f4a9fb3aac9326e41db9209f0.jpg',
                'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_920a55529ae72105a6d04c1428b2f148.jpg',
                'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_9de5f88ab80450810643c92d951508d9.jpg',
                'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_feeab812e960790f21cf7a7b8ebad748.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6/e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_26985140ddd5a28080fa22a4fb89b312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6/e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_4209308f252f516f3d10a49cbe7ea60d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6/e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_ebcc280f4a9fb3aac9326e41db9209f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6/e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_920a55529ae72105a6d04c1428b2f148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6/e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_9de5f88ab80450810643c92d951508d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6/e2d3c9b6-3e76-55f2-8c7c-c9b96db577b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/0b/d30b7b24cd070ddddf578bb2440f3794/pa/YV19532_feeab812e960790f21cf7a7b8ebad748.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2013}
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV19532%27 HTTP/1.1" 200 None
2026-03-30 11:32:59 [auto1.be] INFO: Saving data for YV19532: {'created_time': 1774870379.092102, 'last_price_update_time': 1774870379.092115, 'auction_closing_time': 1774970160.0}
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV19532') HTTP/1.1" 204 0
2026-03-30 11:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP47231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:07 [scrapy.extensions.logstats] INFO: Crawled 27 pages (at 21 pages/min), scraped 22 items (at 19 items/min)
2026-03-30 11:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-30 11:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ56552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN33185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD51525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW96502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY10395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX72969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:14 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1751 | hits on page: 40
2026-03-30 11:33:14 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-30 11:33:14 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-30 11:33:14 [auto1.be] INFO: Found listing with ID: XG99216
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG99216%27 HTTP/1.1" 200 None
2026-03-30 11:33:14 [auto1.be] INFO: Scrape type for XG99216: 1
2026-03-30 11:33:14 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-30 11:33:14 [auto1.be] INFO: Scrape type for DB28782: 2
2026-03-30 11:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782
2026-03-30 11:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with scrape type 2
2026-03-30 11:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with scrape type 2
2026-03-30 11:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e9bccce-a7df-5fb5-8d37-248a91137ee7, identifier: DB28782
2026-03-30 11:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782
2026-03-30 11:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782
2026-03-30 11:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e9bccce-a7df-5fb5-8d37-248a91137ee7 with identifier: DB28782 to the API
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:49:51Z',
 'fuel_type': 'diesel',
 'id': '2e9bccce-a7df-5fb5-8d37-248a91137ee7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB28782',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 144486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2019}
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-30 11:33:14 [auto1.be] INFO: Saving data for DB28782: {'auction_closing_time': 1774972191.0, 'created_time': 1774006260.753822, 'last_price_update_time': 1774870394.970751}
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB28782') HTTP/1.1" 204 0
2026-03-30 11:33:14 [auto1.be] INFO: Found listing with ID: AB04209
2026-03-30 11:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB04209%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for AB04209: 1
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: UN98541
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for BC09650: 2
2026-03-30 11:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650
2026-03-30 11:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41f7556-ebc8-57a6-a10f-1c322f204c16 with scrape type 2
2026-03-30 11:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c41f7556-ebc8-57a6-a10f-1c322f204c16 with scrape type 2
2026-03-30 11:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c41f7556-ebc8-57a6-a10f-1c322f204c16, identifier: BC09650
2026-03-30 11:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 11:33:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650
2026-03-30 11:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c41f7556-ebc8-57a6-a10f-1c322f204c16 with identifier: BC09650 to the API
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:30:45Z',
 'fuel_type': 'diesel',
 'id': 'c41f7556-ebc8-57a6-a10f-1c322f204c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC09650',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 207314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Saving data for BC09650: {'auction_closing_time': 1774971045.0, 'created_time': 1773131704.102415, 'last_price_update_time': 1774870395.624165}
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC09650') HTTP/1.1" 204 0
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: GK69889
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69889%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for GK69889: 1
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: DZ46887
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: AP01808
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP01808%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for AP01808: 1
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: HT85066
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: DJ69749
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ69749%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for DJ69749: 1
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: TB60249
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB60249%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for TB60249: 1
2026-03-30 11:33:15 [auto1.be] INFO: Found listing with ID: XX77269
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX77269%27 HTTP/1.1" 200 None
2026-03-30 11:33:15 [auto1.be] INFO: Scrape type for XX77269: 2
2026-03-30 11:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbe3af6f-d24d-58a4-8719-fd7ebf0199b2 with identifier: XX77269
2026-03-30 11:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbe3af6f-d24d-58a4-8719-fd7ebf0199b2 with scrape type 2
2026-03-30 11:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbe3af6f-d24d-58a4-8719-fd7ebf0199b2 with scrape type 2
2026-03-30 11:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fbe3af6f-d24d-58a4-8719-fd7ebf0199b2, identifier: XX77269
2026-03-30 11:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fbe3af6f-d24d-58a4-8719-fd7ebf0199b2 with identifier: XX77269
2026-03-30 11:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fbe3af6f-d24d-58a4-8719-fd7ebf0199b2 with identifier: XX77269
2026-03-30 11:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fbe3af6f-d24d-58a4-8719-fd7ebf0199b2 with identifier: XX77269 to the API
2026-03-30 11:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-31T15:59:09Z',
 'fuel_type': 'hybrid',
 'id': 'fbe3af6f-d24d-58a4-8719-fd7ebf0199b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX77269',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 100046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-05',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Rubicon',
 'transmission': 'automatic',
 'trim': 'Rubicon',
 'year': 2022}
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX77269%27 HTTP/1.1" 200 None
2026-03-30 11:33:16 [auto1.be] INFO: Saving data for XX77269: {'auction_closing_time': 1774972749.0, 'created_time': 1774298022.983685, 'last_price_update_time': 1774870396.153078}
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XX77269') HTTP/1.1" 204 0
2026-03-30 11:33:16 [auto1.be] INFO: Found listing with ID: GR73680
2026-03-30 11:33:16 [auto1.be] INFO: Found listing with ID: XT71941
2026-03-30 11:33:16 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-30 11:33:16 [auto1.be] INFO: Scrape type for CM55843: 2
2026-03-30 11:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843
2026-03-30 11:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eb73a80-660e-55c5-9c81-44e2f75df7ef with scrape type 2
2026-03-30 11:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eb73a80-660e-55c5-9c81-44e2f75df7ef with scrape type 2
2026-03-30 11:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6eb73a80-660e-55c5-9c81-44e2f75df7ef, identifier: CM55843
2026-03-30 11:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843
2026-03-30 11:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843
2026-03-30 11:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6eb73a80-660e-55c5-9c81-44e2f75df7ef with identifier: CM55843 to the API
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:18:51Z',
 'fuel_type': 'diesel',
 'id': '6eb73a80-660e-55c5-9c81-44e2f75df7ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM55843',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 215865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-13',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2014}
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-30 11:33:16 [auto1.be] INFO: Saving data for CM55843: {'auction_closing_time': 1774970331.0, 'created_time': 1773131869.197768, 'last_price_update_time': 1774870396.73294}
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM55843') HTTP/1.1" 204 0
2026-03-30 11:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT59438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:16 [auto1.be] INFO: Found listing with ID: EN31029
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN31029%27 HTTP/1.1" 200 None
2026-03-30 11:33:16 [auto1.be] INFO: Scrape type for EN31029: 2
2026-03-30 11:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e1b6383-c7fe-51d7-8f00-c18d27bb185f with identifier: EN31029
2026-03-30 11:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e1b6383-c7fe-51d7-8f00-c18d27bb185f with scrape type 2
2026-03-30 11:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e1b6383-c7fe-51d7-8f00-c18d27bb185f with scrape type 2
2026-03-30 11:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e1b6383-c7fe-51d7-8f00-c18d27bb185f, identifier: EN31029
2026-03-30 11:33:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e1b6383-c7fe-51d7-8f00-c18d27bb185f with identifier: EN31029
2026-03-30 11:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e1b6383-c7fe-51d7-8f00-c18d27bb185f with identifier: EN31029
2026-03-30 11:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e1b6383-c7fe-51d7-8f00-c18d27bb185f with identifier: EN31029 to the API
2026-03-30 11:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:28:12Z',
 'fuel_type': 'petrol',
 'id': '5e1b6383-c7fe-51d7-8f00-c18d27bb185f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN31029',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 27607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2016}
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN31029%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Saving data for EN31029: {'auction_closing_time': 1774970892.0, 'created_time': 1773520479.500838, 'last_price_update_time': 1774870397.180155}
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN31029') HTTP/1.1" 204 0
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: TU92557
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU92557%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for TU92557: 1
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: LK77855
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK77855%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for LK77855: 2
2026-03-30 11:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 195678d2-35ed-54a4-a7ca-1485da38e261 with identifier: LK77855
2026-03-30 11:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 195678d2-35ed-54a4-a7ca-1485da38e261 with scrape type 2
2026-03-30 11:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 195678d2-35ed-54a4-a7ca-1485da38e261 with scrape type 2
2026-03-30 11:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 195678d2-35ed-54a4-a7ca-1485da38e261, identifier: LK77855
2026-03-30 11:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 195678d2-35ed-54a4-a7ca-1485da38e261 with identifier: LK77855
2026-03-30 11:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 195678d2-35ed-54a4-a7ca-1485da38e261 with identifier: LK77855
2026-03-30 11:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 195678d2-35ed-54a4-a7ca-1485da38e261 with identifier: LK77855 to the API
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:19:31Z',
 'fuel_type': 'diesel',
 'id': '195678d2-35ed-54a4-a7ca-1485da38e261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK77855',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 177715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK77855%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Saving data for LK77855: {'auction_closing_time': 1774970371.0, 'created_time': 1774298110.451525, 'last_price_update_time': 1774870397.637795}
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK77855') HTTP/1.1" 204 0
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: EY60903
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY60903%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for EY60903: 1
2026-03-30 11:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC49978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: TF54485
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF54485%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for TF54485: 1
2026-03-30 11:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: PH47402
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: EC96968
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC96968%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for EC96968: 1
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: SG30557
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG30557%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for SG30557: 1
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: LM23300
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: GM44657
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: RF68102
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF68102%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for RF68102: 1
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: TJ66513
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ66513%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for TJ66513: 1
2026-03-30 11:33:17 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-30 11:33:17 [auto1.be] INFO: Scrape type for RW00406: 2
2026-03-30 11:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406
2026-03-30 11:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f68311d0-1ecc-575d-906f-63b0a5f1396d with scrape type 2
2026-03-30 11:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f68311d0-1ecc-575d-906f-63b0a5f1396d with scrape type 2
2026-03-30 11:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f68311d0-1ecc-575d-906f-63b0a5f1396d, identifier: RW00406
2026-03-30 11:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406
2026-03-30 11:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406
2026-03-30 11:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f68311d0-1ecc-575d-906f-63b0a5f1396d with identifier: RW00406 to the API
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-31T15:49:23Z',
 'fuel_type': 'hybrid',
 'id': 'f68311d0-1ecc-575d-906f-63b0a5f1396d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW00406',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 175003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2017}
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-30 11:33:18 [auto1.be] INFO: Saving data for RW00406: {'auction_closing_time': 1774972163.0, 'created_time': 1773301740.777086, 'last_price_update_time': 1774870398.27192}
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW00406') HTTP/1.1" 204 0
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: JX51559
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: BA58536
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA58536%27 HTTP/1.1" 200 None
2026-03-30 11:33:18 [auto1.be] INFO: Scrape type for BA58536: 1
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: DT44623
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: NW05600
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW05600%27 HTTP/1.1" 200 None
2026-03-30 11:33:18 [auto1.be] INFO: Scrape type for NW05600: 1
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: FW28464
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: HT53317
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: LR48078
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: PL66290
2026-03-30 11:33:18 [auto1.be] INFO: Found listing with ID: LV37866
2026-03-30 11:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP47231> (referer: https://www.auto1.com/v1/car-details-view/GP47231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2ff936-00db-5566-a0c0-76057e73f2ec with identifier: GP47231
2026-03-30 11:33:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2ff936-00db-5566-a0c0-76057e73f2ec with scrape type 1
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d2ff936-00db-5566-a0c0-76057e73f2ec
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_6a125ccbfae62ababed56570f54840ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_6a125ccbfae62ababed56570f54840ac.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_40a96ac6be1f5a0091c70b8691ec5666.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_40a96ac6be1f5a0091c70b8691ec5666.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_83f61ccceb89274c606126f91553dcb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_83f61ccceb89274c606126f91553dcb4.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_cddefd71db61867af298455715a843b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_cddefd71db61867af298455715a843b9.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_bf9c1349088902f3ff697f97b8445318.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_bf9c1349088902f3ff697f97b8445318.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_0e05d550c8f59a9e08c63df090359a93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_0e05d550c8f59a9e08c63df090359a93.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_0c667788bff3619abc822192efd9542a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_0c667788bff3619abc822192efd9542a.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_465182601a77fa19672b94bf72ca3b96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_465182601a77fa19672b94bf72ca3b96.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_b4a7ade2de50ccd51cb2b22ee45f1a9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_b4a7ade2de50ccd51cb2b22ee45f1a9d.jpg already downloaded
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F2c%252F1e2c914bba12682d6165eee57a0c5f29%252Fpa%252FGP47231_ba41c0487158a8495af14def8836e673.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_ba41c0487158a8495af14def8836e673.jpg already downloaded
2026-03-30 11:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d2ff936-00db-5566-a0c0-76057e73f2ec, identifier: GP47231
2026-03-30 11:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d2ff936-00db-5566-a0c0-76057e73f2ec with identifier: GP47231
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:33:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d2ff936-00db-5566-a0c0-76057e73f2ec with identifier: GP47231
2026-03-30 11:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d2ff936-00db-5566-a0c0-76057e73f2ec with identifier: GP47231 to the API
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP47231>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:38:37Z',
 'fuel_type': 'diesel',
 'id': '7d2ff936-00db-5566-a0c0-76057e73f2ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP47231',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '3er',
 'odometer': 107806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_6a125ccbfae62ababed56570f54840ac.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_40a96ac6be1f5a0091c70b8691ec5666.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_83f61ccceb89274c606126f91553dcb4.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_cddefd71db61867af298455715a843b9.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_bf9c1349088902f3ff697f97b8445318.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_0e05d550c8f59a9e08c63df090359a93.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_0c667788bff3619abc822192efd9542a.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_465182601a77fa19672b94bf72ca3b96.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_b4a7ade2de50ccd51cb2b22ee45f1a9d.jpg',
                'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_ba41c0487158a8495af14def8836e673.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_6a125ccbfae62ababed56570f54840ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_40a96ac6be1f5a0091c70b8691ec5666.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_83f61ccceb89274c606126f91553dcb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_cddefd71db61867af298455715a843b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_bf9c1349088902f3ff697f97b8445318.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_0e05d550c8f59a9e08c63df090359a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_0c667788bff3619abc822192efd9542a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_465182601a77fa19672b94bf72ca3b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_b4a7ade2de50ccd51cb2b22ee45f1a9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d2ff936-00db-5566-a0c0-76057e73f2ec/7d2ff936-00db-5566-a0c0-76057e73f2ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/2c/1e2c914bba12682d6165eee57a0c5f29/pa/GP47231_ba41c0487158a8495af14def8836e673.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP47231%27 HTTP/1.1" 200 None
2026-03-30 11:33:23 [auto1.be] INFO: Saving data for GP47231: {'created_time': 1774870403.754346, 'last_price_update_time': 1774870403.754365, 'auction_closing_time': 1774971517.0}
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GP47231') HTTP/1.1" 204 0
2026-03-30 11:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT98114/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT72624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ56552> (referer: https://www.auto1.com/v1/car-details-view/BZ56552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b3b79f-fb51-5831-bf16-b334997dc426 with identifier: BZ56552
2026-03-30 11:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b3b79f-fb51-5831-bf16-b334997dc426 with scrape type 1
2026-03-30 11:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_54c8241e50f836395386790d7438058e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_54c8241e50f836395386790d7438058e.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_5534dbb3c44e5be48d0edf77c365dc66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_5534dbb3c44e5be48d0edf77c365dc66.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_3853e39893461e4b21bcbf3e9db16813.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_3853e39893461e4b21bcbf3e9db16813.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_6e331184c9ba30aa4339a9a7ed263e40.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_6e331184c9ba30aa4339a9a7ed263e40.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_768e15c486f0aaa495bfac2f428a7be0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_768e15c486f0aaa495bfac2f428a7be0.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_0324ed09c47af8f8d04b05b1678cc996.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_0324ed09c47af8f8d04b05b1678cc996.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_f736f0ad03be235fbc20d7672dfd4d28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_f736f0ad03be235fbc20d7672dfd4d28.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_e709df1c0896d470e631d0766dcf43d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_e709df1c0896d470e631d0766dcf43d8.jpg not downloaded yet
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_9aec8717177861080347b1b315796fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_9aec8717177861080347b1b315796fb7.jpg not downloaded yet
2026-03-30 11:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY44737/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_9aec8717177861080347b1b315796fb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12f590>
2026-03-30 11:33:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_9aec8717177861080347b1b315796fb7.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_9aec8717177861080347b1b315796fb7.jpg saved to cache
2026-03-30 11:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY10395> (referer: https://www.auto1.com/v1/car-details-view/TY10395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6b5552-6184-59a1-a5e3-c622b7b504ae with identifier: TY10395
2026-03-30 11:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6b5552-6184-59a1-a5e3-c622b7b504ae with scrape type 1
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_d1c59822ff4308104a84664ed27abb4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_d1c59822ff4308104a84664ed27abb4f.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_bc4516ce1af751d8e22722920898dc7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_bc4516ce1af751d8e22722920898dc7e.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_9613008446ef22d17c9a74d95029bbd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9613008446ef22d17c9a74d95029bbd5.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_da7a9fce0794dc44728dfec137fad1e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_da7a9fce0794dc44728dfec137fad1e8.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_9a94e6eb82675a2a50d14b2acf92e4d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9a94e6eb82675a2a50d14b2acf92e4d9.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_609f6305635a5d1ef23f23daa1671e8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_609f6305635a5d1ef23f23daa1671e8a.jpg not downloaded yet
2026-03-30 11:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_e709df1c0896d470e631d0766dcf43d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_4ec8caf73e6482e430ef85f20f84ec4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4ec8caf73e6482e430ef85f20f84ec4a.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_345aa3675ed29d6e0a0572a508e3939c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_345aa3675ed29d6e0a0572a508e3939c.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_4cdae3cdebd7db2611e60d05f60b405a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4cdae3cdebd7db2611e60d05f60b405a.jpg not downloaded yet
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_805bdd3aa406a64bca2bf28c37b4a589.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_805bdd3aa406a64bca2bf28c37b4a589.jpg not downloaded yet
2026-03-30 11:33:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97dc190>
2026-03-30 11:33:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_e709df1c0896d470e631d0766dcf43d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_e709df1c0896d470e631d0766dcf43d8.jpg saved to cache
2026-03-30 11:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_609f6305635a5d1ef23f23daa1671e8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_805bdd3aa406a64bca2bf28c37b4a589.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea09c550>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_609f6305635a5d1ef23f23daa1671e8a.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_609f6305635a5d1ef23f23daa1671e8a.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4cdae3cdebd7db2611e60d05f60b405a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cdf10>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_805bdd3aa406a64bca2bf28c37b4a589.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_805bdd3aa406a64bca2bf28c37b4a589.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98028d0>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_4cdae3cdebd7db2611e60d05f60b405a.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4cdae3cdebd7db2611e60d05f60b405a.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX72969> (referer: https://www.auto1.com/v1/car-details-view/AX72969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4ec8caf73e6482e430ef85f20f84ec4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9a94e6eb82675a2a50d14b2acf92e4d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c474aa1-5332-5652-bf64-cceb3a7f3db0 with identifier: AX72969
2026-03-30 11:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0 with scrape type 1
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg not downloaded yet
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_ee7de1f69e1c1404085962a44a3639b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_ee7de1f69e1c1404085962a44a3639b2.jpg not downloaded yet
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_9fd6c5a91ace91c9a050034dd8ac0dfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_9fd6c5a91ace91c9a050034dd8ac0dfe.jpg not downloaded yet
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_345aa3675ed29d6e0a0572a508e3939c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_da7a9fce0794dc44728dfec137fad1e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_3890878ed9780cbe1e0cab2db0c348f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_3890878ed9780cbe1e0cab2db0c348f6.jpg not downloaded yet
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea21bfd0>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_4ec8caf73e6482e430ef85f20f84ec4a.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4ec8caf73e6482e430ef85f20f84ec4a.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_2090c7738e37b7db6df32bb6919f543f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_2090c7738e37b7db6df32bb6919f543f.jpg not downloaded yet
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_88b1a9ceb6f958b3fabaa5f8cabdd3fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_88b1a9ceb6f958b3fabaa5f8cabdd3fc.jpg not downloaded yet
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981aa50>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_9a94e6eb82675a2a50d14b2acf92e4d9.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9a94e6eb82675a2a50d14b2acf92e4d9.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_338f96f66681affbf38a28434ef50f38.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_338f96f66681affbf38a28434ef50f38.jpg not downloaded yet
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_91f129c08333f19774132de2014266c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_91f129c08333f19774132de2014266c6.jpg not downloaded yet
2026-03-30 11:33:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea101b50>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_345aa3675ed29d6e0a0572a508e3939c.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_345aa3675ed29d6e0a0572a508e3939c.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b3050>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_da7a9fce0794dc44728dfec137fad1e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_da7a9fce0794dc44728dfec137fad1e8.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_e0597dc4a43918b368432f1bc2d3d348.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_e0597dc4a43918b368432f1bc2d3d348.jpg not downloaded yet
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_9fd6c5a91ace91c9a050034dd8ac0dfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_ee7de1f69e1c1404085962a44a3639b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_6e95189ea368278b16058417155d531e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_6e95189ea368278b16058417155d531e.jpg not downloaded yet
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e986a910>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_9fd6c5a91ace91c9a050034dd8ac0dfe.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_9fd6c5a91ace91c9a050034dd8ac0dfe.jpg saved to cache
2026-03-30 11:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0f7e10>
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_ee7de1f69e1c1404085962a44a3639b2.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_ee7de1f69e1c1404085962a44a3639b2.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_91f129c08333f19774132de2014266c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_e0597dc4a43918b368432f1bc2d3d348.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_6e95189ea368278b16058417155d531e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN33185> (referer: https://www.auto1.com/v1/car-details-view/EN33185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ce310>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_91f129c08333f19774132de2014266c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_91f129c08333f19774132de2014266c6.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b0cd0>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_e0597dc4a43918b368432f1bc2d3d348.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_e0597dc4a43918b368432f1bc2d3d348.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea09c890>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_6e95189ea368278b16058417155d531e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_6e95189ea368278b16058417155d531e.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46902522-5416-5605-bd13-1123560ee41a with identifier: EN33185
2026-03-30 11:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46902522-5416-5605-bd13-1123560ee41a with scrape type 1
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_81646987533cb7e9bde3035bc4ac8c55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_81646987533cb7e9bde3035bc4ac8c55.jpg not downloaded yet
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_c64585305c330b0ed3613e821bc10f50.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_c64585305c330b0ed3613e821bc10f50.jpg not downloaded yet
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_338f96f66681affbf38a28434ef50f38.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_88b1a9ceb6f958b3fabaa5f8cabdd3fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_2fe7d9bccca6f9606962196f5adef683.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_2fe7d9bccca6f9606962196f5adef683.jpg not downloaded yet
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_61ca6592d47411de32580003b71b7f47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_61ca6592d47411de32580003b71b7f47.jpg not downloaded yet
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_227626f113557d561fed4a537fd7dd31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_227626f113557d561fed4a537fd7dd31.jpg not downloaded yet
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_8073b965c32cb6b6ea3098dde251bf9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_8073b965c32cb6b6ea3098dde251bf9f.jpg not downloaded yet
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_2090c7738e37b7db6df32bb6919f543f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_81646987533cb7e9bde3035bc4ac8c55.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b9990>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_338f96f66681affbf38a28434ef50f38.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_338f96f66681affbf38a28434ef50f38.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9817750>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_88b1a9ceb6f958b3fabaa5f8cabdd3fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_88b1a9ceb6f958b3fabaa5f8cabdd3fc.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea258650>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_2090c7738e37b7db6df32bb6919f543f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_2090c7738e37b7db6df32bb6919f543f.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96afa10>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_81646987533cb7e9bde3035bc4ac8c55.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_81646987533cb7e9bde3035bc4ac8c55.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_3890878ed9780cbe1e0cab2db0c348f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_8073b965c32cb6b6ea3098dde251bf9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_61ca6592d47411de32580003b71b7f47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_227626f113557d561fed4a537fd7dd31.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_2fe7d9bccca6f9606962196f5adef683.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_c64585305c330b0ed3613e821bc10f50.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b0f90>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_3890878ed9780cbe1e0cab2db0c348f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_3890878ed9780cbe1e0cab2db0c348f6.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_bc4516ce1af751d8e22722920898dc7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9818e50>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_8073b965c32cb6b6ea3098dde251bf9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_8073b965c32cb6b6ea3098dde251bf9f.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2154d0>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_61ca6592d47411de32580003b71b7f47.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_61ca6592d47411de32580003b71b7f47.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fa950>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_227626f113557d561fed4a537fd7dd31.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_227626f113557d561fed4a537fd7dd31.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975afd0>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_2fe7d9bccca6f9606962196f5adef683.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_2fe7d9bccca6f9606962196f5adef683.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975f050>
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fa5%252F54a5c35fbe112f10dc2326ae3e08daf6%252Fpa%252FEN33185_c64585305c330b0ed3613e821bc10f50.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_c64585305c330b0ed3613e821bc10f50.jpg saved to cache
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46902522-5416-5605-bd13-1123560ee41a
2026-03-30 11:33:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46902522-5416-5605-bd13-1123560ee41a, skipping ID generation
2026-03-30 11:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46902522-5416-5605-bd13-1123560ee41a with scrape type 1
2026-03-30 11:33:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46902522-5416-5605-bd13-1123560ee41a sending to next pipeline
2026-03-30 11:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46902522-5416-5605-bd13-1123560ee41a, identifier: EN33185
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e2b10>
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_bc4516ce1af751d8e22722920898dc7e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_bc4516ce1af751d8e22722920898dc7e.jpg saved to cache
2026-03-30 11:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46902522-5416-5605-bd13-1123560ee41a with identifier: EN33185
2026-03-30 11:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46902522-5416-5605-bd13-1123560ee41a with identifier: EN33185
2026-03-30 11:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46902522-5416-5605-bd13-1123560ee41a with identifier: EN33185 to the API
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_c64585305c330b0ed3613e821bc10f50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:10:01Z',
 'fuel_type': 'diesel',
 'id': '46902522-5416-5605-bd13-1123560ee41a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN33185',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 272598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_81646987533cb7e9bde3035bc4ac8c55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_c64585305c330b0ed3613e821bc10f50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_2fe7d9bccca6f9606962196f5adef683.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_61ca6592d47411de32580003b71b7f47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_227626f113557d561fed4a537fd7dd31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46902522-5416-5605-bd13-1123560ee41a/46902522-5416-5605-bd13-1123560ee41a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/a5/54a5c35fbe112f10dc2326ae3e08daf6/pa/EN33185_8073b965c32cb6b6ea3098dde251bf9f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Tech Run',
 'transmission': 'manual',
 'trim': 'Tech Run',
 'year': 2011}
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN33185%27 HTTP/1.1" 200 None
2026-03-30 11:33:34 [auto1.be] INFO: Saving data for EN33185: {'created_time': 1774870414.63144, 'last_price_update_time': 1774870414.631454, 'auction_closing_time': 1774969801.0}
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN33185') HTTP/1.1" 204 0
2026-03-30 11:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9613008446ef22d17c9a74d95029bbd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_d1c59822ff4308104a84664ed27abb4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_f736f0ad03be235fbc20d7672dfd4d28.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98699d0>
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff8%252Fc7f816877fe2a49bcb014ca2e269b7b1%252Fpa%252FAX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg saved to cache
2026-03-30 11:33:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0
2026-03-30 11:33:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c474aa1-5332-5652-bf64-cceb3a7f3db0, skipping ID generation
2026-03-30 11:33:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0 with scrape type 1
2026-03-30 11:33:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c474aa1-5332-5652-bf64-cceb3a7f3db0 sending to next pipeline
2026-03-30 11:33:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c474aa1-5332-5652-bf64-cceb3a7f3db0, identifier: AX72969
2026-03-30 11:33:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c474aa1-5332-5652-bf64-cceb3a7f3db0 with identifier: AX72969
2026-03-30 11:33:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c474aa1-5332-5652-bf64-cceb3a7f3db0 with identifier: AX72969
2026-03-30 11:33:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c474aa1-5332-5652-bf64-cceb3a7f3db0 with identifier: AX72969 to the API
2026-03-30 11:33:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:37:24Z',
 'fuel_type': 'petrol',
 'id': '2c474aa1-5332-5652-bf64-cceb3a7f3db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX72969',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 188326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_b9a3e1f8f0b14210bfdc5406f9cad17e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_ee7de1f69e1c1404085962a44a3639b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_9fd6c5a91ace91c9a050034dd8ac0dfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_3890878ed9780cbe1e0cab2db0c348f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_2090c7738e37b7db6df32bb6919f543f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_88b1a9ceb6f958b3fabaa5f8cabdd3fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_338f96f66681affbf38a28434ef50f38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_91f129c08333f19774132de2014266c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_e0597dc4a43918b368432f1bc2d3d348.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c474aa1-5332-5652-bf64-cceb3a7f3db0/2c474aa1-5332-5652-bf64-cceb3a7f3db0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f8/c7f816877fe2a49bcb014ca2e269b7b1/pa/AX72969_6e95189ea368278b16058417155d531e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2008}
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX72969%27 HTTP/1.1" 200 None
2026-03-30 11:33:35 [auto1.be] INFO: Saving data for AX72969: {'created_time': 1774870415.18368, 'last_price_update_time': 1774870415.183695, 'auction_closing_time': 1774971444.0}
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX72969') HTTP/1.1" 204 0
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0eca90>
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_9613008446ef22d17c9a74d95029bbd5.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9613008446ef22d17c9a74d95029bbd5.jpg saved to cache
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e42d0>
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F5f%252F845ffd78899a901d9a329eb1af428fc3%252Fpa%252FTY10395_d1c59822ff4308104a84664ed27abb4f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_d1c59822ff4308104a84664ed27abb4f.jpg saved to cache
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee6b5552-6184-59a1-a5e3-c622b7b504ae
2026-03-30 11:33:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee6b5552-6184-59a1-a5e3-c622b7b504ae, skipping ID generation
2026-03-30 11:33:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6b5552-6184-59a1-a5e3-c622b7b504ae with scrape type 1
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee6b5552-6184-59a1-a5e3-c622b7b504ae sending to next pipeline
2026-03-30 11:33:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee6b5552-6184-59a1-a5e3-c622b7b504ae, identifier: TY10395
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cd990>
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_f736f0ad03be235fbc20d7672dfd4d28.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_f736f0ad03be235fbc20d7672dfd4d28.jpg saved to cache
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_0324ed09c47af8f8d04b05b1678cc996.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_6e331184c9ba30aa4339a9a7ed263e40.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_768e15c486f0aaa495bfac2f428a7be0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee6b5552-6184-59a1-a5e3-c622b7b504ae with identifier: TY10395
2026-03-30 11:33:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee6b5552-6184-59a1-a5e3-c622b7b504ae with identifier: TY10395
2026-03-30 11:33:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee6b5552-6184-59a1-a5e3-c622b7b504ae with identifier: TY10395 to the API
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_d1c59822ff4308104a84664ed27abb4f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Taxi',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:29:04Z',
 'fuel_type': 'hybrid',
 'id': 'ee6b5552-6184-59a1-a5e3-c622b7b504ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY10395',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 158908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_d1c59822ff4308104a84664ed27abb4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_bc4516ce1af751d8e22722920898dc7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9613008446ef22d17c9a74d95029bbd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_da7a9fce0794dc44728dfec137fad1e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_9a94e6eb82675a2a50d14b2acf92e4d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2016721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_609f6305635a5d1ef23f23daa1671e8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4ec8caf73e6482e430ef85f20f84ec4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2070108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_345aa3675ed29d6e0a0572a508e3939c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_4cdae3cdebd7db2611e60d05f60b405a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee6b5552-6184-59a1-a5e3-c622b7b504ae/ee6b5552-6184-59a1-a5e3-c622b7b504ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/5f/845ffd78899a901d9a329eb1af428fc3/pa/TY10395_805bdd3aa406a64bca2bf28c37b4a589.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10395%27 HTTP/1.1" 200 None
2026-03-30 11:33:35 [auto1.be] INFO: Saving data for TY10395: {'created_time': 1774870415.864573, 'last_price_update_time': 1774870415.864583, 'auction_closing_time': 1774970944.0}
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY10395') HTTP/1.1" 204 0
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981b3d0>
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_0324ed09c47af8f8d04b05b1678cc996.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_0324ed09c47af8f8d04b05b1678cc996.jpg saved to cache
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea132090>
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_6e331184c9ba30aa4339a9a7ed263e40.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_6e331184c9ba30aa4339a9a7ed263e40.jpg saved to cache
2026-03-30 11:33:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a4490>
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_768e15c486f0aaa495bfac2f428a7be0.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_768e15c486f0aaa495bfac2f428a7be0.jpg saved to cache
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_3853e39893461e4b21bcbf3e9db16813.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_54c8241e50f836395386790d7438058e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_5534dbb3c44e5be48d0edf77c365dc66.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a71d0>
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_3853e39893461e4b21bcbf3e9db16813.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_3853e39893461e4b21bcbf3e9db16813.jpg saved to cache
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c3510>
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_54c8241e50f836395386790d7438058e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_54c8241e50f836395386790d7438058e.jpg saved to cache
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a4b10>
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_5534dbb3c44e5be48d0edf77c365dc66.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_5534dbb3c44e5be48d0edf77c365dc66.jpg saved to cache
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9851e90>
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F0e%252Fc80ee48de01d82504bda4dd6a3804014%252Fpa%252FBZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg saved to cache
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79b3b79f-fb51-5831-bf16-b334997dc426
2026-03-30 11:33:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79b3b79f-fb51-5831-bf16-b334997dc426, skipping ID generation
2026-03-30 11:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b3b79f-fb51-5831-bf16-b334997dc426 with scrape type 1
2026-03-30 11:33:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79b3b79f-fb51-5831-bf16-b334997dc426 sending to next pipeline
2026-03-30 11:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79b3b79f-fb51-5831-bf16-b334997dc426, identifier: BZ56552
2026-03-30 11:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79b3b79f-fb51-5831-bf16-b334997dc426 with identifier: BZ56552
2026-03-30 11:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79b3b79f-fb51-5831-bf16-b334997dc426 with identifier: BZ56552
2026-03-30 11:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79b3b79f-fb51-5831-bf16-b334997dc426 with identifier: BZ56552 to the API
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:33:12Z',
 'fuel_type': 'diesel',
 'id': '79b3b79f-fb51-5831-bf16-b334997dc426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ56552',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 180451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_54c8241e50f836395386790d7438058e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_5534dbb3c44e5be48d0edf77c365dc66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_3853e39893461e4b21bcbf3e9db16813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_cdfdcda7ec12c9007dbd935b1c304bf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_6e331184c9ba30aa4339a9a7ed263e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_768e15c486f0aaa495bfac2f428a7be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_0324ed09c47af8f8d04b05b1678cc996.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_f736f0ad03be235fbc20d7672dfd4d28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_e709df1c0896d470e631d0766dcf43d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b3b79f-fb51-5831-bf16-b334997dc426/79b3b79f-fb51-5831-bf16-b334997dc426_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/0e/c80ee48de01d82504bda4dd6a3804014/pa/BZ56552_9aec8717177861080347b1b315796fb7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend lang',
 'year': 2018}
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ56552%27 HTTP/1.1" 200 None
2026-03-30 11:33:36 [auto1.be] INFO: Saving data for BZ56552: {'created_time': 1774870416.858855, 'last_price_update_time': 1774870416.858867, 'auction_closing_time': 1774971192.0}
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ56552') HTTP/1.1" 204 0
2026-03-30 11:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY60903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW96502> (referer: https://www.auto1.com/v1/car-details-view/VW96502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e67327-c751-52d4-85ff-05b3869d2032 with identifier: VW96502
2026-03-30 11:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e67327-c751-52d4-85ff-05b3869d2032 with scrape type 1
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_91474fa5ce5165c48369c0566f20121c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_91474fa5ce5165c48369c0566f20121c.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_a0e845d5d6def63229073b5a5d304eb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_a0e845d5d6def63229073b5a5d304eb0.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_36666274797f5407045170c9ff53f08d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_36666274797f5407045170c9ff53f08d.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_939708a157865ffe1b0785c3860f1985.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_939708a157865ffe1b0785c3860f1985.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_2022e5508bc30eba7c5c902f7b662319.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_2022e5508bc30eba7c5c902f7b662319.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_b965d7cca39e8055864aebffee87f530.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_b965d7cca39e8055864aebffee87f530.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_aa162b6c269408486a299ed61d97a45c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_aa162b6c269408486a299ed61d97a45c.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_fcb5ec6e2ee4025c14e6bbc02ed88f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_fcb5ec6e2ee4025c14e6bbc02ed88f5d.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_0f802a9a0ce43e85babd0af8ec5072dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_0f802a9a0ce43e85babd0af8ec5072dc.jpg not downloaded yet
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_46f50a4abc002e2184de5e763c9abd89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_46f50a4abc002e2184de5e763c9abd89.jpg not downloaded yet
2026-03-30 11:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD51525> (referer: https://www.auto1.com/v1/car-details-view/XD51525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abe2aac-cbef-5b96-881a-2c4fb71afb7c with identifier: XD51525
2026-03-30 11:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c with scrape type 1
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_f10918330ac9e57223ec16c179476841.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_f10918330ac9e57223ec16c179476841.jpg not downloaded yet
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_1711813f761b5f1a4c38ff668d3dd333.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_1711813f761b5f1a4c38ff668d3dd333.jpg not downloaded yet
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_a2f70ef9ce892975197136aa45a5bc9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_a2f70ef9ce892975197136aa45a5bc9f.jpg not downloaded yet
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_235950e8bdd07d15a160384b13a839f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_235950e8bdd07d15a160384b13a839f8.jpg not downloaded yet
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_5c463d590f735314fbd37ff8d8019a2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_5c463d590f735314fbd37ff8d8019a2a.jpg not downloaded yet
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_58de7f84213119c269ae3b1e256a87b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_58de7f84213119c269ae3b1e256a87b7.jpg not downloaded yet
2026-03-30 11:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_46f50a4abc002e2184de5e763c9abd89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e6850>
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_46f50a4abc002e2184de5e763c9abd89.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_46f50a4abc002e2184de5e763c9abd89.jpg saved to cache
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_58de7f84213119c269ae3b1e256a87b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9808e90>
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_58de7f84213119c269ae3b1e256a87b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_58de7f84213119c269ae3b1e256a87b7.jpg saved to cache
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_5c463d590f735314fbd37ff8d8019a2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_235950e8bdd07d15a160384b13a839f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea117ed0>
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_5c463d590f735314fbd37ff8d8019a2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_5c463d590f735314fbd37ff8d8019a2a.jpg saved to cache
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cd4d0>
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_235950e8bdd07d15a160384b13a839f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_235950e8bdd07d15a160384b13a839f8.jpg saved to cache
2026-03-30 11:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_a2f70ef9ce892975197136aa45a5bc9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e6dd0>
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_a2f70ef9ce892975197136aa45a5bc9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_a2f70ef9ce892975197136aa45a5bc9f.jpg saved to cache
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_1711813f761b5f1a4c38ff668d3dd333.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_f10918330ac9e57223ec16c179476841.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9861dd0>
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_1711813f761b5f1a4c38ff668d3dd333.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_1711813f761b5f1a4c38ff668d3dd333.jpg saved to cache
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b4290>
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5e%252Fa85eb01e52397475a65060a8551dd1af%252Fpa%252FXD51525_f10918330ac9e57223ec16c179476841.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_f10918330ac9e57223ec16c179476841.jpg saved to cache
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c
2026-03-30 11:33:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6abe2aac-cbef-5b96-881a-2c4fb71afb7c, skipping ID generation
2026-03-30 11:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c with scrape type 1
2026-03-30 11:33:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6abe2aac-cbef-5b96-881a-2c4fb71afb7c sending to next pipeline
2026-03-30 11:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6abe2aac-cbef-5b96-881a-2c4fb71afb7c, identifier: XD51525
2026-03-30 11:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6abe2aac-cbef-5b96-881a-2c4fb71afb7c with identifier: XD51525
2026-03-30 11:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6abe2aac-cbef-5b96-881a-2c4fb71afb7c with identifier: XD51525
2026-03-30 11:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6abe2aac-cbef-5b96-881a-2c4fb71afb7c with identifier: XD51525 to the API
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_f10918330ac9e57223ec16c179476841.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:43:44Z',
 'fuel_type': 'diesel',
 'id': '6abe2aac-cbef-5b96-881a-2c4fb71afb7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD51525',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 276560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_f10918330ac9e57223ec16c179476841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_1711813f761b5f1a4c38ff668d3dd333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_a2f70ef9ce892975197136aa45a5bc9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_235950e8bdd07d15a160384b13a839f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_5c463d590f735314fbd37ff8d8019a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6abe2aac-cbef-5b96-881a-2c4fb71afb7c/6abe2aac-cbef-5b96-881a-2c4fb71afb7c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5e/a85eb01e52397475a65060a8551dd1af/pa/XD51525_58de7f84213119c269ae3b1e256a87b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD51525%27 HTTP/1.1" 200 None
2026-03-30 11:33:41 [auto1.be] INFO: Saving data for XD51525: {'created_time': 1774870421.988164, 'last_price_update_time': 1774870421.988174, 'auction_closing_time': 1774971824.0}
2026-03-30 11:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD51525') HTTP/1.1" 204 0
2026-03-30 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_0f802a9a0ce43e85babd0af8ec5072dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a7a90>
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_0f802a9a0ce43e85babd0af8ec5072dc.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_0f802a9a0ce43e85babd0af8ec5072dc.jpg saved to cache
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_fcb5ec6e2ee4025c14e6bbc02ed88f5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW05600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e7410>
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_fcb5ec6e2ee4025c14e6bbc02ed88f5d.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_fcb5ec6e2ee4025c14e6bbc02ed88f5d.jpg saved to cache
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_b965d7cca39e8055864aebffee87f530.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9808d50>
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_b965d7cca39e8055864aebffee87f530.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_b965d7cca39e8055864aebffee87f530.jpg saved to cache
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_aa162b6c269408486a299ed61d97a45c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9833410>
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_aa162b6c269408486a299ed61d97a45c.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_aa162b6c269408486a299ed61d97a45c.jpg saved to cache
2026-03-30 11:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_2022e5508bc30eba7c5c902f7b662319.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b7650>
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_2022e5508bc30eba7c5c902f7b662319.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_2022e5508bc30eba7c5c902f7b662319.jpg saved to cache
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_939708a157865ffe1b0785c3860f1985.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9833c10>
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_939708a157865ffe1b0785c3860f1985.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_939708a157865ffe1b0785c3860f1985.jpg saved to cache
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT98114> (referer: https://www.auto1.com/v1/car-details-view/XT98114/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_36666274797f5407045170c9ff53f08d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f639c36f-da22-5c80-9ab1-430c19056130 with identifier: XT98114
2026-03-30 11:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f639c36f-da22-5c80-9ab1-430c19056130 with scrape type 1
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_c6a6cf28b9eec97d62d7035a620873a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c6a6cf28b9eec97d62d7035a620873a8.jpg not downloaded yet
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_f34dc774898d0a2b74f001bbc444c778.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_f34dc774898d0a2b74f001bbc444c778.jpg not downloaded yet
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_9458d23ce55aeb5eddf162feaa2fc777.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_9458d23ce55aeb5eddf162feaa2fc777.jpg not downloaded yet
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_28bb52ce94d170f95bf38002bca128b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_28bb52ce94d170f95bf38002bca128b7.jpg not downloaded yet
2026-03-30 11:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_91474fa5ce5165c48369c0566f20121c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_b2f0e51efd117491b9b872eebc725898.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_b2f0e51efd117491b9b872eebc725898.jpg not downloaded yet
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_c391f18d028dec100155a33fef10c2f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c391f18d028dec100155a33fef10c2f7.jpg not downloaded yet
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_3b6281a8d616a5075ad8925bd769b335.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_3b6281a8d616a5075ad8925bd769b335.jpg not downloaded yet
2026-03-30 11:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_a0e845d5d6def63229073b5a5d304eb0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_518c8238838dbf8ba07c9b59b1c150a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_518c8238838dbf8ba07c9b59b1c150a4.jpg not downloaded yet
2026-03-30 11:33:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec013850>
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_36666274797f5407045170c9ff53f08d.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_36666274797f5407045170c9ff53f08d.jpg saved to cache
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_1e49a30608664a1bf96ecd432feb0d6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_1e49a30608664a1bf96ecd432feb0d6f.jpg not downloaded yet
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_95b892835c7e7bed3dc20705bd905d99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_95b892835c7e7bed3dc20705bd905d99.jpg not downloaded yet
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9821710>
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_91474fa5ce5165c48369c0566f20121c.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_91474fa5ce5165c48369c0566f20121c.jpg saved to cache
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12fdd0>
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252Fc6%252F13c6aa432805f9e01ecdc2ac85648874%252Fpa%252FVW96502_a0e845d5d6def63229073b5a5d304eb0.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_a0e845d5d6def63229073b5a5d304eb0.jpg saved to cache
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0e67327-c751-52d4-85ff-05b3869d2032
2026-03-30 11:33:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0e67327-c751-52d4-85ff-05b3869d2032, skipping ID generation
2026-03-30 11:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e67327-c751-52d4-85ff-05b3869d2032 with scrape type 1
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0e67327-c751-52d4-85ff-05b3869d2032 sending to next pipeline
2026-03-30 11:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0e67327-c751-52d4-85ff-05b3869d2032, identifier: VW96502
2026-03-30 11:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0e67327-c751-52d4-85ff-05b3869d2032 with identifier: VW96502
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:33:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0e67327-c751-52d4-85ff-05b3869d2032 with identifier: VW96502
2026-03-30 11:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0e67327-c751-52d4-85ff-05b3869d2032 with identifier: VW96502 to the API
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_a0e845d5d6def63229073b5a5d304eb0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:41:13Z',
 'fuel_type': 'petrol',
 'id': 'a0e67327-c751-52d4-85ff-05b3869d2032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW96502',
 'listing': 'auction',
 'location': 'BE, Antwerpen',
 'make': 'Fiat',
 'model': '500',
 'odometer': 37106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_91474fa5ce5165c48369c0566f20121c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_a0e845d5d6def63229073b5a5d304eb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_36666274797f5407045170c9ff53f08d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_939708a157865ffe1b0785c3860f1985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_2022e5508bc30eba7c5c902f7b662319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_b965d7cca39e8055864aebffee87f530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604259,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_aa162b6c269408486a299ed61d97a45c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_fcb5ec6e2ee4025c14e6bbc02ed88f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_0f802a9a0ce43e85babd0af8ec5072dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0e67327-c751-52d4-85ff-05b3869d2032/a0e67327-c751-52d4-85ff-05b3869d2032_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2316606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/c6/13c6aa432805f9e01ecdc2ac85648874/pa/VW96502_46f50a4abc002e2184de5e763c9abd89.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW96502%27 HTTP/1.1" 200 None
2026-03-30 11:33:44 [auto1.be] INFO: Saving data for VW96502: {'created_time': 1774870424.654448, 'last_price_update_time': 1774870424.654459, 'auction_closing_time': 1774971673.0}
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW96502') HTTP/1.1" 204 0
2026-03-30 11:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_3b6281a8d616a5075ad8925bd769b335.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT72624> (referer: https://www.auto1.com/v1/car-details-view/HT72624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_28bb52ce94d170f95bf38002bca128b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaef0710>
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_3b6281a8d616a5075ad8925bd769b335.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_3b6281a8d616a5075ad8925bd769b335.jpg saved to cache
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY44737> (referer: https://www.auto1.com/v1/car-details-view/NY44737/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c0b362-2323-59f4-b281-61b05ee892d8 with identifier: HT72624
2026-03-30 11:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c0b362-2323-59f4-b281-61b05ee892d8 with scrape type 1
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_5f05fce8df02122c8f92779d432e79ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5f05fce8df02122c8f92779d432e79ac.jpg not downloaded yet
2026-03-30 11:33:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9803490>
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_28bb52ce94d170f95bf38002bca128b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_28bb52ce94d170f95bf38002bca128b7.jpg saved to cache
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_95b892835c7e7bed3dc20705bd905d99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_6255f805e6ce744120caceaa207b9e22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_6255f805e6ce744120caceaa207b9e22.jpg not downloaded yet
2026-03-30 11:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_1e49a30608664a1bf96ecd432feb0d6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e7f7089-cf6b-5355-891a-3d28696efc1d with identifier: NY44737
2026-03-30 11:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e7f7089-cf6b-5355-891a-3d28696efc1d with scrape type 1
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e7f7089-cf6b-5355-891a-3d28696efc1d
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_991f2bada39b7e3f6b0b2b6a1da809c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_991f2bada39b7e3f6b0b2b6a1da809c1.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_df564a6709ed3e5e1384e25f4a333e15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_df564a6709ed3e5e1384e25f4a333e15.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_d3d912c29764d1fd89e5155670cb613d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d3d912c29764d1fd89e5155670cb613d.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_d4a11567a82d33af0182db07c50b17bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d4a11567a82d33af0182db07c50b17bd.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_d137803e55995de77039b10afb3a2858.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d137803e55995de77039b10afb3a2858.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_d598f2639c1066adf6f7ef6ae7c65184.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d598f2639c1066adf6f7ef6ae7c65184.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_22e30dfac56e5be524840f792cbfdf64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_22e30dfac56e5be524840f792cbfdf64.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_7a131b9e5a5bec862897bd9c530a3274.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_7a131b9e5a5bec862897bd9c530a3274.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_f55d726e478410315c8c8b704160daa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_f55d726e478410315c8c8b704160daa4.jpg already downloaded
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fca%252Fe3caea81aab6bb128a5db2f50e89db8a%252Fpa%252FNY44737_e206eacd8a50af8da907ae58bd421b30.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_e206eacd8a50af8da907ae58bd421b30.jpg already downloaded
2026-03-30 11:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e7f7089-cf6b-5355-891a-3d28696efc1d, identifier: NY44737
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_1c213916caf7c12e05ee387c62bf2194.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1c213916caf7c12e05ee387c62bf2194.jpg not downloaded yet
2026-03-30 11:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e7f7089-cf6b-5355-891a-3d28696efc1d with identifier: NY44737
2026-03-30 11:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e7f7089-cf6b-5355-891a-3d28696efc1d with identifier: NY44737
2026-03-30 11:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e7f7089-cf6b-5355-891a-3d28696efc1d with identifier: NY44737 to the API
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY44737>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:24:05Z',
 'fuel_type': 'diesel',
 'id': '7e7f7089-cf6b-5355-891a-3d28696efc1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY44737',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '1er',
 'odometer': 126569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_991f2bada39b7e3f6b0b2b6a1da809c1.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_df564a6709ed3e5e1384e25f4a333e15.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d3d912c29764d1fd89e5155670cb613d.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d4a11567a82d33af0182db07c50b17bd.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d137803e55995de77039b10afb3a2858.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d598f2639c1066adf6f7ef6ae7c65184.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_22e30dfac56e5be524840f792cbfdf64.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_7a131b9e5a5bec862897bd9c530a3274.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_f55d726e478410315c8c8b704160daa4.jpg',
                'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_e206eacd8a50af8da907ae58bd421b30.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684450,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_991f2bada39b7e3f6b0b2b6a1da809c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_df564a6709ed3e5e1384e25f4a333e15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d3d912c29764d1fd89e5155670cb613d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d4a11567a82d33af0182db07c50b17bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d137803e55995de77039b10afb3a2858.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_d598f2639c1066adf6f7ef6ae7c65184.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_22e30dfac56e5be524840f792cbfdf64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_7a131b9e5a5bec862897bd9c530a3274.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_f55d726e478410315c8c8b704160daa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e7f7089-cf6b-5355-891a-3d28696efc1d/7e7f7089-cf6b-5355-891a-3d28696efc1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/ca/e3caea81aab6bb128a5db2f50e89db8a/pa/NY44737_e206eacd8a50af8da907ae58bd421b30.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics',
 'transmission': 'manual',
 'trim': 'EfficientDynamics',
 'year': 2017}
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY44737%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [auto1.be] INFO: Saving data for NY44737: {'created_time': 1774870425.773384, 'last_price_update_time': 1774870425.773397, 'auction_closing_time': 1774970645.0}
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY44737') HTTP/1.1" 204 0
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_fcd9547848c58ead2a3c55fe56e7a372.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_fcd9547848c58ead2a3c55fe56e7a372.jpg not downloaded yet
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9861dd0>
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_95b892835c7e7bed3dc20705bd905d99.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_95b892835c7e7bed3dc20705bd905d99.jpg saved to cache
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9847a50>
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_1e49a30608664a1bf96ecd432feb0d6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_1e49a30608664a1bf96ecd432feb0d6f.jpg saved to cache
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_5fcf7703fe04b2f9f80cafb2e4b9c9f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5fcf7703fe04b2f9f80cafb2e4b9c9f6.jpg not downloaded yet
2026-03-30 11:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5f05fce8df02122c8f92779d432e79ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_2337fc2c019e48cede34223a576a89a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_2337fc2c019e48cede34223a576a89a4.jpg not downloaded yet
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_1e7a082c8e20de5efc328bd7018317ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1e7a082c8e20de5efc328bd7018317ab.jpg not downloaded yet
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_79d4ca377d617602b28db0073170d02f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_79d4ca377d617602b28db0073170d02f.jpg not downloaded yet
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_74de24c79554e8513bee6d2cb3260a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_74de24c79554e8513bee6d2cb3260a15.jpg not downloaded yet
2026-03-30 11:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_b2f0e51efd117491b9b872eebc725898.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_fcd9547848c58ead2a3c55fe56e7a372.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_38fac882c5c2a84992f3ce3d03784e93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_38fac882c5c2a84992f3ce3d03784e93.jpg not downloaded yet
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_518c8238838dbf8ba07c9b59b1c150a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e969da10>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_5f05fce8df02122c8f92779d432e79ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5f05fce8df02122c8f92779d432e79ac.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_79d4ca377d617602b28db0073170d02f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_74de24c79554e8513bee6d2cb3260a15.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea10cdd0>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_b2f0e51efd117491b9b872eebc725898.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_b2f0e51efd117491b9b872eebc725898.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22dc90>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_fcd9547848c58ead2a3c55fe56e7a372.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_fcd9547848c58ead2a3c55fe56e7a372.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1e7a082c8e20de5efc328bd7018317ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_2337fc2c019e48cede34223a576a89a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea102150>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_518c8238838dbf8ba07c9b59b1c150a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_518c8238838dbf8ba07c9b59b1c150a4.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea100b10>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_79d4ca377d617602b28db0073170d02f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_79d4ca377d617602b28db0073170d02f.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98083d0>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_74de24c79554e8513bee6d2cb3260a15.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_74de24c79554e8513bee6d2cb3260a15.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b1e90>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_1e7a082c8e20de5efc328bd7018317ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1e7a082c8e20de5efc328bd7018317ab.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a7d50>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_2337fc2c019e48cede34223a576a89a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_2337fc2c019e48cede34223a576a89a4.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5fcf7703fe04b2f9f80cafb2e4b9c9f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1c213916caf7c12e05ee387c62bf2194.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c391f18d028dec100155a33fef10c2f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_6255f805e6ce744120caceaa207b9e22.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b0290>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_5fcf7703fe04b2f9f80cafb2e4b9c9f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5fcf7703fe04b2f9f80cafb2e4b9c9f6.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c6a6cf28b9eec97d62d7035a620873a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA58536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7f879dc10>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_1c213916caf7c12e05ee387c62bf2194.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1c213916caf7c12e05ee387c62bf2194.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d3b10>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_c391f18d028dec100155a33fef10c2f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c391f18d028dec100155a33fef10c2f7.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_9458d23ce55aeb5eddf162feaa2fc777.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebff8210>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_6255f805e6ce744120caceaa207b9e22.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_6255f805e6ce744120caceaa207b9e22.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96afc10>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_c6a6cf28b9eec97d62d7035a620873a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c6a6cf28b9eec97d62d7035a620873a8.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_38fac882c5c2a84992f3ce3d03784e93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaeb9610>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_9458d23ce55aeb5eddf162feaa2fc777.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_9458d23ce55aeb5eddf162feaa2fc777.jpg saved to cache
2026-03-30 11:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_f34dc774898d0a2b74f001bbc444c778.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e4bd0>
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fda%252F42da4821dff8c3b142729d2662313c44%252Fpa%252FHT72624_38fac882c5c2a84992f3ce3d03784e93.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_38fac882c5c2a84992f3ce3d03784e93.jpg saved to cache
2026-03-30 11:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15c0b362-2323-59f4-b281-61b05ee892d8
2026-03-30 11:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15c0b362-2323-59f4-b281-61b05ee892d8, skipping ID generation
2026-03-30 11:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c0b362-2323-59f4-b281-61b05ee892d8 with scrape type 1
2026-03-30 11:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15c0b362-2323-59f4-b281-61b05ee892d8 sending to next pipeline
2026-03-30 11:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15c0b362-2323-59f4-b281-61b05ee892d8, identifier: HT72624
2026-03-30 11:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15c0b362-2323-59f4-b281-61b05ee892d8 with identifier: HT72624
2026-03-30 11:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15c0b362-2323-59f4-b281-61b05ee892d8 with identifier: HT72624
2026-03-30 11:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15c0b362-2323-59f4-b281-61b05ee892d8 with identifier: HT72624 to the API
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_38fac882c5c2a84992f3ce3d03784e93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:14:35Z',
 'fuel_type': 'diesel',
 'id': '15c0b362-2323-59f4-b281-61b05ee892d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT72624',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 61264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5f05fce8df02122c8f92779d432e79ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_6255f805e6ce744120caceaa207b9e22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1c213916caf7c12e05ee387c62bf2194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_fcd9547848c58ead2a3c55fe56e7a372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_5fcf7703fe04b2f9f80cafb2e4b9c9f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_2337fc2c019e48cede34223a576a89a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_1e7a082c8e20de5efc328bd7018317ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_79d4ca377d617602b28db0073170d02f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_74de24c79554e8513bee6d2cb3260a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c0b362-2323-59f4-b281-61b05ee892d8/15c0b362-2323-59f4-b281-61b05ee892d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2952533,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/da/42da4821dff8c3b142729d2662313c44/pa/HT72624_38fac882c5c2a84992f3ce3d03784e93.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT72624%27 HTTP/1.1" 200 None
2026-03-30 11:33:47 [auto1.be] INFO: Saving data for HT72624: {'created_time': 1774870427.668639, 'last_price_update_time': 1774870427.668651, 'auction_closing_time': 1774970075.0}
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT72624') HTTP/1.1" 204 0
2026-03-30 11:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB60249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:33:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e4a90>
2026-03-30 11:33:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F9a%252Fdb9ac8033822610cc719f8fb051434a2%252Fpa%252FXT98114_f34dc774898d0a2b74f001bbc444c778.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_f34dc774898d0a2b74f001bbc444c778.jpg saved to cache
2026-03-30 11:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f639c36f-da22-5c80-9ab1-430c19056130
2026-03-30 11:33:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f639c36f-da22-5c80-9ab1-430c19056130, skipping ID generation
2026-03-30 11:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f639c36f-da22-5c80-9ab1-430c19056130 with scrape type 1
2026-03-30 11:33:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f639c36f-da22-5c80-9ab1-430c19056130 sending to next pipeline
2026-03-30 11:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f639c36f-da22-5c80-9ab1-430c19056130, identifier: XT98114
2026-03-30 11:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f639c36f-da22-5c80-9ab1-430c19056130 with identifier: XT98114
2026-03-30 11:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f639c36f-da22-5c80-9ab1-430c19056130 with identifier: XT98114
2026-03-30 11:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f639c36f-da22-5c80-9ab1-430c19056130 with identifier: XT98114 to the API
2026-03-30 11:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_f34dc774898d0a2b74f001bbc444c778.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:31:16Z',
 'fuel_type': 'petrol',
 'id': 'f639c36f-da22-5c80-9ab1-430c19056130',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT98114',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 30121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c6a6cf28b9eec97d62d7035a620873a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2192686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_f34dc774898d0a2b74f001bbc444c778.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_9458d23ce55aeb5eddf162feaa2fc777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_28bb52ce94d170f95bf38002bca128b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_b2f0e51efd117491b9b872eebc725898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2266607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_c391f18d028dec100155a33fef10c2f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_3b6281a8d616a5075ad8925bd769b335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2317012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_518c8238838dbf8ba07c9b59b1c150a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_1e49a30608664a1bf96ecd432feb0d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f639c36f-da22-5c80-9ab1-430c19056130/f639c36f-da22-5c80-9ab1-430c19056130_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/9a/db9ac8033822610cc719f8fb051434a2/pa/XT98114_95b892835c7e7bed3dc20705bd905d99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2017}
2026-03-30 11:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT98114%27 HTTP/1.1" 200 None
2026-03-30 11:33:48 [auto1.be] INFO: Saving data for XT98114: {'created_time': 1774870428.27552, 'last_price_update_time': 1774870428.275532, 'auction_closing_time': 1774971076.0}
2026-03-30 11:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT98114') HTTP/1.1" 204 0
2026-03-30 11:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF68102/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY60903> (referer: https://www.auto1.com/v1/car-details-view/EY60903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ66513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f3a06e-a705-5480-a586-075decf3d3df with identifier: EY60903
2026-03-30 11:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f3a06e-a705-5480-a586-075decf3d3df with scrape type 1
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_983ee098c8e45f9f8737543475a40207.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_983ee098c8e45f9f8737543475a40207.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_3c01c0dd987023e7113395dce33fcb9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_3c01c0dd987023e7113395dce33fcb9e.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_e4e83a58f18fb8f3bffcf1cc87aa433e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_e4e83a58f18fb8f3bffcf1cc87aa433e.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_20f5dfb1c7a38349b14a55885b81e4ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_20f5dfb1c7a38349b14a55885b81e4ae.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_faaeba7c0638f19c7d173d4f0a508603.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_faaeba7c0638f19c7d173d4f0a508603.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_9877b36c33c6774617e8345b76d1523e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9877b36c33c6774617e8345b76d1523e.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_9e1eb1e1f66d6a1bb006592c398d2cfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9e1eb1e1f66d6a1bb006592c398d2cfe.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_8ef308c11b6164c4e97746a680354a6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_8ef308c11b6164c4e97746a680354a6f.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_ceafc4bf8a100dcff94441b30f3be311.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_ceafc4bf8a100dcff94441b30f3be311.jpg not downloaded yet
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_605a6f1dffaa9459679262df92c1f567.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_605a6f1dffaa9459679262df92c1f567.jpg not downloaded yet
2026-03-30 11:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD24749> (referer: https://www.auto1.com/v1/car-details-view/UD24749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2727bf3-8912-506c-a942-6507730d0f54 with identifier: UD24749
2026-03-30 11:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2727bf3-8912-506c-a942-6507730d0f54 with scrape type 1
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e2727bf3-8912-506c-a942-6507730d0f54
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_56304795a7ee615ef734f8534acd23c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_56304795a7ee615ef734f8534acd23c5.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_6273e550b9523f6873571b50877071a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_6273e550b9523f6873571b50877071a2.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_718d07b21246fe1d64e613d79641cf1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_718d07b21246fe1d64e613d79641cf1d.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_1a401fb86fd8235570e0f609a23eb0ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_1a401fb86fd8235570e0f609a23eb0ff.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_55092dca2bc1bcae6a812b5a05160d45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_55092dca2bc1bcae6a812b5a05160d45.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_f35cfd6dbee90660325bdea4a9ef02f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_f35cfd6dbee90660325bdea4a9ef02f7.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_2127fb7b60d8d69b0d22b821f1b687db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_2127fb7b60d8d69b0d22b821f1b687db.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_34bc5cf20a79d611ebe554364c020223.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_34bc5cf20a79d611ebe554364c020223.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_cc1a328654cbb7ab1b08ad31b8f2d1fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_cc1a328654cbb7ab1b08ad31b8f2d1fd.jpg already downloaded
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F4a%252Fa64a4c46c21a6dd4f758da89eacb6796%252Fpa%252FUD24749_fa59605e8f83e2f51125adec25040383.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_fa59605e8f83e2f51125adec25040383.jpg already downloaded
2026-03-30 11:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2727bf3-8912-506c-a942-6507730d0f54, identifier: UD24749
2026-03-30 11:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2727bf3-8912-506c-a942-6507730d0f54 with identifier: UD24749
2026-03-30 11:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2727bf3-8912-506c-a942-6507730d0f54 with identifier: UD24749
2026-03-30 11:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2727bf3-8912-506c-a942-6507730d0f54 with identifier: UD24749 to the API
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD24749>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:28:46Z',
 'fuel_type': 'diesel',
 'id': 'e2727bf3-8912-506c-a942-6507730d0f54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD24749',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 151086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_56304795a7ee615ef734f8534acd23c5.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_6273e550b9523f6873571b50877071a2.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_718d07b21246fe1d64e613d79641cf1d.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_1a401fb86fd8235570e0f609a23eb0ff.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_55092dca2bc1bcae6a812b5a05160d45.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_f35cfd6dbee90660325bdea4a9ef02f7.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_2127fb7b60d8d69b0d22b821f1b687db.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_34bc5cf20a79d611ebe554364c020223.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_cc1a328654cbb7ab1b08ad31b8f2d1fd.jpg',
                'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_fa59605e8f83e2f51125adec25040383.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_56304795a7ee615ef734f8534acd23c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_6273e550b9523f6873571b50877071a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_718d07b21246fe1d64e613d79641cf1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_1a401fb86fd8235570e0f609a23eb0ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_55092dca2bc1bcae6a812b5a05160d45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_f35cfd6dbee90660325bdea4a9ef02f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_2127fb7b60d8d69b0d22b821f1b687db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_34bc5cf20a79d611ebe554364c020223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_cc1a328654cbb7ab1b08ad31b8f2d1fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2727bf3-8912-506c-a942-6507730d0f54/e2727bf3-8912-506c-a942-6507730d0f54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/4a/a64a4c46c21a6dd4f758da89eacb6796/pa/UD24749_fa59605e8f83e2f51125adec25040383.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2013}
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD24749%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [auto1.be] INFO: Saving data for UD24749: {'created_time': 1774870432.027758, 'last_price_update_time': 1774870432.027769, 'auction_closing_time': 1774970926.0}
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD24749') HTTP/1.1" 204 0
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_605a6f1dffaa9459679262df92c1f567.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9843990>
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_605a6f1dffaa9459679262df92c1f567.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_605a6f1dffaa9459679262df92c1f567.jpg saved to cache
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_ceafc4bf8a100dcff94441b30f3be311.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_8ef308c11b6164c4e97746a680354a6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a9350>
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_ceafc4bf8a100dcff94441b30f3be311.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_ceafc4bf8a100dcff94441b30f3be311.jpg saved to cache
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9e1eb1e1f66d6a1bb006592c398d2cfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea20e710>
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_8ef308c11b6164c4e97746a680354a6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_8ef308c11b6164c4e97746a680354a6f.jpg saved to cache
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9845350>
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_9e1eb1e1f66d6a1bb006592c398d2cfe.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9e1eb1e1f66d6a1bb006592c398d2cfe.jpg saved to cache
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC49978> (referer: https://www.auto1.com/v1/car-details-view/DC49978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9877b36c33c6774617e8345b76d1523e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_20f5dfb1c7a38349b14a55885b81e4ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033 with identifier: DC49978
2026-03-30 11:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033 with scrape type 1
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F89%252F2d89c7e49acaf9ac4ebb0c6ae1154261%252Fpa%252FDC49978_bb0421840d3b8f3f42f0a7c1e6dad6b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_bb0421840d3b8f3f42f0a7c1e6dad6b9.jpg already downloaded
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F89%252F2d89c7e49acaf9ac4ebb0c6ae1154261%252Fpa%252FDC49978_39688e9af14036a84cdaaf9fcc496793.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_39688e9af14036a84cdaaf9fcc496793.jpg already downloaded
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F89%252F2d89c7e49acaf9ac4ebb0c6ae1154261%252Fpa%252FDC49978_03ab8784574f5a0f7ee4686b46dd06d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_03ab8784574f5a0f7ee4686b46dd06d6.jpg already downloaded
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F89%252F2d89c7e49acaf9ac4ebb0c6ae1154261%252Fpa%252FDC49978_ef510dbd03001384e4d860b580325134.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_ef510dbd03001384e4d860b580325134.jpg already downloaded
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F89%252F2d89c7e49acaf9ac4ebb0c6ae1154261%252Fpa%252FDC49978_fbf849c632d1dc27873365d06eb36aed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_fbf849c632d1dc27873365d06eb36aed.jpg already downloaded
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F89%252F2d89c7e49acaf9ac4ebb0c6ae1154261%252Fpa%252FDC49978_03214c1febcb64fcee15db0814d5b849.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_03214c1febcb64fcee15db0814d5b849.jpg already downloaded
2026-03-30 11:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033, identifier: DC49978
2026-03-30 11:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033 with identifier: DC49978
2026-03-30 11:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033 with identifier: DC49978
2026-03-30 11:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033 with identifier: DC49978 to the API
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC49978>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:51:38Z',
 'fuel_type': 'petrol',
 'id': 'a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC49978',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 101488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_bb0421840d3b8f3f42f0a7c1e6dad6b9.jpg',
                'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_39688e9af14036a84cdaaf9fcc496793.jpg',
                'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_03ab8784574f5a0f7ee4686b46dd06d6.jpg',
                'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_ef510dbd03001384e4d860b580325134.jpg',
                'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_fbf849c632d1dc27873365d06eb36aed.jpg',
                'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_03214c1febcb64fcee15db0814d5b849.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033/a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_bb0421840d3b8f3f42f0a7c1e6dad6b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033/a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_39688e9af14036a84cdaaf9fcc496793.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033/a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_03ab8784574f5a0f7ee4686b46dd06d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033/a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_ef510dbd03001384e4d860b580325134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033/a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_fbf849c632d1dc27873365d06eb36aed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033/a0fe3120-6ad6-56b6-bfb2-c9a8a4f1c033_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/89/2d89c7e49acaf9ac4ebb0c6ae1154261/pa/DC49978_03214c1febcb64fcee15db0814d5b849.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 140 L Elegance',
 'transmission': 'manual',
 'trim': 'L Elegance',
 'year': 2004}
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC49978%27 HTTP/1.1" 200 None
2026-03-30 11:33:53 [auto1.be] INFO: Saving data for DC49978: {'created_time': 1774870433.288785, 'last_price_update_time': 1774870433.288796, 'auction_closing_time': 1774972298.0}
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DC49978') HTTP/1.1" 204 0
2026-03-30 11:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_faaeba7c0638f19c7d173d4f0a508603.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF54485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9766cd0>
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_9877b36c33c6774617e8345b76d1523e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9877b36c33c6774617e8345b76d1523e.jpg saved to cache
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97dd0d0>
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_20f5dfb1c7a38349b14a55885b81e4ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_20f5dfb1c7a38349b14a55885b81e4ae.jpg saved to cache
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG30557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96aa290>
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_faaeba7c0638f19c7d173d4f0a508603.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_faaeba7c0638f19c7d173d4f0a508603.jpg saved to cache
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_983ee098c8e45f9f8737543475a40207.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_e4e83a58f18fb8f3bffcf1cc87aa433e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96adf50>
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_983ee098c8e45f9f8737543475a40207.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_983ee098c8e45f9f8737543475a40207.jpg saved to cache
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e7890>
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_e4e83a58f18fb8f3bffcf1cc87aa433e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_e4e83a58f18fb8f3bffcf1cc87aa433e.jpg saved to cache
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_3c01c0dd987023e7113395dce33fcb9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96afad0>
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F77%252Fbb77623efc575ed0e47e3811e069a673%252Fpa%252FEY60903_3c01c0dd987023e7113395dce33fcb9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_3c01c0dd987023e7113395dce33fcb9e.jpg saved to cache
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45f3a06e-a705-5480-a586-075decf3d3df
2026-03-30 11:33:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45f3a06e-a705-5480-a586-075decf3d3df, skipping ID generation
2026-03-30 11:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f3a06e-a705-5480-a586-075decf3d3df with scrape type 1
2026-03-30 11:33:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45f3a06e-a705-5480-a586-075decf3d3df sending to next pipeline
2026-03-30 11:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45f3a06e-a705-5480-a586-075decf3d3df, identifier: EY60903
2026-03-30 11:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45f3a06e-a705-5480-a586-075decf3d3df with identifier: EY60903
2026-03-30 11:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45f3a06e-a705-5480-a586-075decf3d3df with identifier: EY60903
2026-03-30 11:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45f3a06e-a705-5480-a586-075decf3d3df with identifier: EY60903 to the API
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_3c01c0dd987023e7113395dce33fcb9e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:19:02Z',
 'fuel_type': 'petrol',
 'id': '45f3a06e-a705-5480-a586-075decf3d3df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY60903',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 50331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_983ee098c8e45f9f8737543475a40207.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_3c01c0dd987023e7113395dce33fcb9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_e4e83a58f18fb8f3bffcf1cc87aa433e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_20f5dfb1c7a38349b14a55885b81e4ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_faaeba7c0638f19c7d173d4f0a508603.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9877b36c33c6774617e8345b76d1523e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_9e1eb1e1f66d6a1bb006592c398d2cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_8ef308c11b6164c4e97746a680354a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_ceafc4bf8a100dcff94441b30f3be311.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45f3a06e-a705-5480-a586-075decf3d3df/45f3a06e-a705-5480-a586-075decf3d3df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/77/bb77623efc575ed0e47e3811e069a673/pa/EY60903_605a6f1dffaa9459679262df92c1f567.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY60903%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [auto1.be] INFO: Saving data for EY60903: {'created_time': 1774870434.347426, 'last_price_update_time': 1774870434.347436, 'auction_closing_time': 1774970342.0}
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY60903') HTTP/1.1" 204 0
2026-03-30 11:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW05600> (referer: https://www.auto1.com/v1/car-details-view/NW05600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA58536> (referer: https://www.auto1.com/v1/car-details-view/BA58536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990341ce-974e-5e34-80d2-bc8b9f98d6d4 with identifier: NW05600
2026-03-30 11:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4 with scrape type 1
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg not downloaded yet
2026-03-30 11:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 with identifier: BA58536
2026-03-30 11:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 with scrape type 1
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_c1f814c53b6307b3922bfb04feb4a84d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_c1f814c53b6307b3922bfb04feb4a84d.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_0626dfcc4d94f15ad4741f093fe1e2d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0626dfcc4d94f15ad4741f093fe1e2d5.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_dd6ab1b701b2727de656f0e0848cfe6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_dd6ab1b701b2727de656f0e0848cfe6a.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_c939fd858b03259b7d40d2b4f64abf44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_c939fd858b03259b7d40d2b4f64abf44.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_e9825016180d47c0cd33816da643ae5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_e9825016180d47c0cd33816da643ae5f.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_2766ba4135826ccb15f71889ec73fe00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_2766ba4135826ccb15f71889ec73fe00.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_cc8f155fb3513ea707df86bbb8bd98f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_cc8f155fb3513ea707df86bbb8bd98f8.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_0f710ea77be63b7d22f35a8d132245a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0f710ea77be63b7d22f35a8d132245a9.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_0d258202994796b78a0ac150801f64c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_0d258202994796b78a0ac150801f64c2.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_b8596b882df02c0e9b215d72c1c9bbcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_b8596b882df02c0e9b215d72c1c9bbcb.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_b6e2fab625a3747d83ea999c1ad5913b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_b6e2fab625a3747d83ea999c1ad5913b.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_a5cc38069f12a1aba9ac7638a1a1d363.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_a5cc38069f12a1aba9ac7638a1a1d363.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_9b723e69077f0075e68259c9343a6888.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_9b723e69077f0075e68259c9343a6888.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_90cd745db96e895034b50767272673a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_90cd745db96e895034b50767272673a9.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_634b6b97531f59e4af352f896b5aa183.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_634b6b97531f59e4af352f896b5aa183.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_27839071152b30a4d62753a46f22d652.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_27839071152b30a4d62753a46f22d652.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_bddef4e6a059d3b8e3b0daa3e15606c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_bddef4e6a059d3b8e3b0daa3e15606c7.jpg not downloaded yet
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_cd18f01a55897b4e8c02db253e72d662.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cd18f01a55897b4e8c02db253e72d662.jpg not downloaded yet
2026-03-30 11:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ69749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cd18f01a55897b4e8c02db253e72d662.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fc310>
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_cd18f01a55897b4e8c02db253e72d662.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cd18f01a55897b4e8c02db253e72d662.jpg saved to cache
2026-03-30 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_bddef4e6a059d3b8e3b0daa3e15606c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98425d0>
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_bddef4e6a059d3b8e3b0daa3e15606c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_bddef4e6a059d3b8e3b0daa3e15606c7.jpg saved to cache
2026-03-30 11:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC96968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_27839071152b30a4d62753a46f22d652.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_634b6b97531f59e4af352f896b5aa183.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97de450>
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_27839071152b30a4d62753a46f22d652.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_27839071152b30a4d62753a46f22d652.jpg saved to cache
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9759210>
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_634b6b97531f59e4af352f896b5aa183.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_634b6b97531f59e4af352f896b5aa183.jpg saved to cache
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB60249> (referer: https://www.auto1.com/v1/car-details-view/TB60249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:33:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_90cd745db96e895034b50767272673a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8768bc34-1397-5fc5-92f3-375ce82b700b with identifier: TB60249
2026-03-30 11:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8768bc34-1397-5fc5-92f3-375ce82b700b with scrape type 1
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_7ee66b5eaf73fb9322a8854d0a9e3ff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7ee66b5eaf73fb9322a8854d0a9e3ff0.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_92f0355dc3d5ce34d269246827ed4480.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_92f0355dc3d5ce34d269246827ed4480.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_5048f7e31e86551147036f45b9a5d40e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_5048f7e31e86551147036f45b9a5d40e.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_1b754801c9b2fd74f7fc0e97a89badfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_1b754801c9b2fd74f7fc0e97a89badfc.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_d47061888f08aa211471b43b89d78c98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_d47061888f08aa211471b43b89d78c98.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_be96793f86fbeca950c9dcb316802531.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_be96793f86fbeca950c9dcb316802531.jpg not downloaded yet
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b2f90>
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_90cd745db96e895034b50767272673a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_90cd745db96e895034b50767272673a9.jpg saved to cache
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_b4b8e8ef9696d6fca217f330fd9a06fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b4b8e8ef9696d6fca217f330fd9a06fd.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_3537e12a019d985fe0461e4a65c12de6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_3537e12a019d985fe0461e4a65c12de6.jpg not downloaded yet
2026-03-30 11:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_9b723e69077f0075e68259c9343a6888.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_b49cfe31971bf726a1243fc3c948ccf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b49cfe31971bf726a1243fc3c948ccf6.jpg not downloaded yet
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_7076ddc66fcc7f1c064e863190290825.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7076ddc66fcc7f1c064e863190290825.jpg not downloaded yet
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96afed0>
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:33:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:33:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_9b723e69077f0075e68259c9343a6888.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_9b723e69077f0075e68259c9343a6888.jpg saved to cache
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_3537e12a019d985fe0461e4a65c12de6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97ddc10>
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_3537e12a019d985fe0461e4a65c12de6.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_3537e12a019d985fe0461e4a65c12de6.jpg saved to cache
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7076ddc66fcc7f1c064e863190290825.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebff9a10>
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_7076ddc66fcc7f1c064e863190290825.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7076ddc66fcc7f1c064e863190290825.jpg saved to cache
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b49cfe31971bf726a1243fc3c948ccf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea27ff50>
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_b49cfe31971bf726a1243fc3c948ccf6.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b49cfe31971bf726a1243fc3c948ccf6.jpg saved to cache
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b4b8e8ef9696d6fca217f330fd9a06fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebfef750>
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_b4b8e8ef9696d6fca217f330fd9a06fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b4b8e8ef9696d6fca217f330fd9a06fd.jpg saved to cache
2026-03-30 11:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_be96793f86fbeca950c9dcb316802531.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96adb50>
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_be96793f86fbeca950c9dcb316802531.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_be96793f86fbeca950c9dcb316802531.jpg saved to cache
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_d47061888f08aa211471b43b89d78c98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea191cd0>
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_d47061888f08aa211471b43b89d78c98.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_d47061888f08aa211471b43b89d78c98.jpg saved to cache
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU92557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_1b754801c9b2fd74f7fc0e97a89badfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_5048f7e31e86551147036f45b9a5d40e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7ee66b5eaf73fb9322a8854d0a9e3ff0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e6ed0>
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_1b754801c9b2fd74f7fc0e97a89badfc.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_1b754801c9b2fd74f7fc0e97a89badfc.jpg saved to cache
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f6410>
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_5048f7e31e86551147036f45b9a5d40e.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_5048f7e31e86551147036f45b9a5d40e.jpg saved to cache
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea20c0d0>
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_7ee66b5eaf73fb9322a8854d0a9e3ff0.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7ee66b5eaf73fb9322a8854d0a9e3ff0.jpg saved to cache
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_92f0355dc3d5ce34d269246827ed4480.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_a5cc38069f12a1aba9ac7638a1a1d363.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96aee90>
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fcd%252F49cd2da50bce07507da01b16e66d11ae%252Fpa%252FTB60249_92f0355dc3d5ce34d269246827ed4480.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_92f0355dc3d5ce34d269246827ed4480.jpg saved to cache
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8768bc34-1397-5fc5-92f3-375ce82b700b
2026-03-30 11:34:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8768bc34-1397-5fc5-92f3-375ce82b700b, skipping ID generation
2026-03-30 11:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8768bc34-1397-5fc5-92f3-375ce82b700b with scrape type 1
2026-03-30 11:34:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8768bc34-1397-5fc5-92f3-375ce82b700b sending to next pipeline
2026-03-30 11:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8768bc34-1397-5fc5-92f3-375ce82b700b, identifier: TB60249
2026-03-30 11:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8768bc34-1397-5fc5-92f3-375ce82b700b with identifier: TB60249
2026-03-30 11:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8768bc34-1397-5fc5-92f3-375ce82b700b with identifier: TB60249
2026-03-30 11:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8768bc34-1397-5fc5-92f3-375ce82b700b with identifier: TB60249 to the API
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_92f0355dc3d5ce34d269246827ed4480.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:43:30Z',
 'fuel_type': 'petrol',
 'id': '8768bc34-1397-5fc5-92f3-375ce82b700b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB60249',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 90325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7ee66b5eaf73fb9322a8854d0a9e3ff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_92f0355dc3d5ce34d269246827ed4480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_5048f7e31e86551147036f45b9a5d40e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_1b754801c9b2fd74f7fc0e97a89badfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_d47061888f08aa211471b43b89d78c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_be96793f86fbeca950c9dcb316802531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b4b8e8ef9696d6fca217f330fd9a06fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_3537e12a019d985fe0461e4a65c12de6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_b49cfe31971bf726a1243fc3c948ccf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8768bc34-1397-5fc5-92f3-375ce82b700b/8768bc34-1397-5fc5-92f3-375ce82b700b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/cd/49cd2da50bce07507da01b16e66d11ae/pa/TB60249_7076ddc66fcc7f1c064e863190290825.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB60249%27 HTTP/1.1" 200 None
2026-03-30 11:34:02 [auto1.be] INFO: Saving data for TB60249: {'created_time': 1774870442.428286, 'last_price_update_time': 1774870442.428298, 'auction_closing_time': 1774971810.0}
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TB60249') HTTP/1.1" 204 0
2026-03-30 11:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_b6e2fab625a3747d83ea999c1ad5913b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97df650>
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_a5cc38069f12a1aba9ac7638a1a1d363.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_a5cc38069f12a1aba9ac7638a1a1d363.jpg saved to cache
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_b8596b882df02c0e9b215d72c1c9bbcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea101490>
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_b6e2fab625a3747d83ea999c1ad5913b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_b6e2fab625a3747d83ea999c1ad5913b.jpg saved to cache
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f6c90>
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_b8596b882df02c0e9b215d72c1c9bbcb.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_b8596b882df02c0e9b215d72c1c9bbcb.jpg saved to cache
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_0d258202994796b78a0ac150801f64c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0f710ea77be63b7d22f35a8d132245a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9863410>
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_0d258202994796b78a0ac150801f64c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_0d258202994796b78a0ac150801f64c2.jpg saved to cache
2026-03-30 11:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a6e50>
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_0f710ea77be63b7d22f35a8d132245a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0f710ea77be63b7d22f35a8d132245a9.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_cc8f155fb3513ea707df86bbb8bd98f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_2766ba4135826ccb15f71889ec73fe00.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97df810>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_cc8f155fb3513ea707df86bbb8bd98f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_cc8f155fb3513ea707df86bbb8bd98f8.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fd890>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_2766ba4135826ccb15f71889ec73fe00.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_2766ba4135826ccb15f71889ec73fe00.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_e9825016180d47c0cd33816da643ae5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_c939fd858b03259b7d40d2b4f64abf44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT59438> (referer: https://www.auto1.com/v1/car-details-view/AT59438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9860350>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_e9825016180d47c0cd33816da643ae5f.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_e9825016180d47c0cd33816da643ae5f.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96aff10>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_c939fd858b03259b7d40d2b4f64abf44.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_c939fd858b03259b7d40d2b4f64abf44.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0626dfcc4d94f15ad4741f093fe1e2d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1163a30-464d-5c47-a90d-57103b6fd3c8 with identifier: AT59438
2026-03-30 11:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1163a30-464d-5c47-a90d-57103b6fd3c8 with scrape type 1
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_c67b669ea319358fb3cde643cbfac6f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_c67b669ea319358fb3cde643cbfac6f9.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_ad53ad0c8ab93cd99250532934490cb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_ad53ad0c8ab93cd99250532934490cb7.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_0bac02b567c8a158cc6a4d9fd79c902b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_0bac02b567c8a158cc6a4d9fd79c902b.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_7e2915ebed27334a6be465065e571d13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_7e2915ebed27334a6be465065e571d13.jpg not downloaded yet
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_dd6ab1b701b2727de656f0e0848cfe6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_351b6f48d420945746b7fdbd3ede2bf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_351b6f48d420945746b7fdbd3ede2bf8.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_fe65a31a0b6d493005850b91bec4d133.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_fe65a31a0b6d493005850b91bec4d133.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_e25183c1ba0704f4be0c74aa3c6c23e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_e25183c1ba0704f4be0c74aa3c6c23e8.jpg not downloaded yet
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea100550>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_0626dfcc4d94f15ad4741f093fe1e2d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0626dfcc4d94f15ad4741f093fe1e2d5.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_30111c1e91afb11ecdf93259f7ad76f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_30111c1e91afb11ecdf93259f7ad76f2.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_6ecce2a969282b4dfa6fc67c5be1c9b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_6ecce2a969282b4dfa6fc67c5be1c9b6.jpg not downloaded yet
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_b85efc635e8368d41cbe5cc9443c29b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_b85efc635e8368d41cbe5cc9443c29b0.jpg not downloaded yet
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e6750>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_dd6ab1b701b2727de656f0e0848cfe6a.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_dd6ab1b701b2727de656f0e0848cfe6a.jpg saved to cache
2026-03-30 11:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_c1f814c53b6307b3922bfb04feb4a84d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_7e2915ebed27334a6be465065e571d13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_6ecce2a969282b4dfa6fc67c5be1c9b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fa7d0>
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_c1f814c53b6307b3922bfb04feb4a84d.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_c1f814c53b6307b3922bfb04feb4a84d.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_30111c1e91afb11ecdf93259f7ad76f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e3350>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_7e2915ebed27334a6be465065e571d13.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_7e2915ebed27334a6be465065e571d13.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea258810>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_6ecce2a969282b4dfa6fc67c5be1c9b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_6ecce2a969282b4dfa6fc67c5be1c9b6.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_b85efc635e8368d41cbe5cc9443c29b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a9350>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_30111c1e91afb11ecdf93259f7ad76f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_30111c1e91afb11ecdf93259f7ad76f2.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_fe65a31a0b6d493005850b91bec4d133.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_e25183c1ba0704f4be0c74aa3c6c23e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22ed10>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_b85efc635e8368d41cbe5cc9443c29b0.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_b85efc635e8368d41cbe5cc9443c29b0.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_351b6f48d420945746b7fdbd3ede2bf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96aaa50>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_fe65a31a0b6d493005850b91bec4d133.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_fe65a31a0b6d493005850b91bec4d133.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea235e50>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_e25183c1ba0704f4be0c74aa3c6c23e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_e25183c1ba0704f4be0c74aa3c6c23e8.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_0bac02b567c8a158cc6a4d9fd79c902b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_ad53ad0c8ab93cd99250532934490cb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea205010>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_351b6f48d420945746b7fdbd3ede2bf8.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_351b6f48d420945746b7fdbd3ede2bf8.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_c67b669ea319358fb3cde643cbfac6f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea115590>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_0bac02b567c8a158cc6a4d9fd79c902b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_0bac02b567c8a158cc6a4d9fd79c902b.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b25d0>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_ad53ad0c8ab93cd99250532934490cb7.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_ad53ad0c8ab93cd99250532934490cb7.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9759fd0>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F4d%252Fb24d24f76197de0a5dc4e0713416c083%252Fpa%252FAT59438_c67b669ea319358fb3cde643cbfac6f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_c67b669ea319358fb3cde643cbfac6f9.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1163a30-464d-5c47-a90d-57103b6fd3c8
2026-03-30 11:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1163a30-464d-5c47-a90d-57103b6fd3c8, skipping ID generation
2026-03-30 11:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1163a30-464d-5c47-a90d-57103b6fd3c8 with scrape type 1
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1163a30-464d-5c47-a90d-57103b6fd3c8 sending to next pipeline
2026-03-30 11:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1163a30-464d-5c47-a90d-57103b6fd3c8, identifier: AT59438
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1e2490>
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F0e%252F8d0e3144000d4d65eb5143db7aadc9b8%252Fpa%252FBA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg saved to cache
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676
2026-03-30 11:34:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676, skipping ID generation
2026-03-30 11:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 with scrape type 1
2026-03-30 11:34:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 sending to next pipeline
2026-03-30 11:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676, identifier: BA58536
2026-03-30 11:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1163a30-464d-5c47-a90d-57103b6fd3c8 with identifier: AT59438
2026-03-30 11:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1163a30-464d-5c47-a90d-57103b6fd3c8 with identifier: AT59438
2026-03-30 11:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1163a30-464d-5c47-a90d-57103b6fd3c8 with identifier: AT59438 to the API
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_c67b669ea319358fb3cde643cbfac6f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:01:04Z',
 'fuel_type': 'petrol',
 'id': 'a1163a30-464d-5c47-a90d-57103b6fd3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT59438',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 167329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_c67b669ea319358fb3cde643cbfac6f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_ad53ad0c8ab93cd99250532934490cb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_0bac02b567c8a158cc6a4d9fd79c902b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_7e2915ebed27334a6be465065e571d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_351b6f48d420945746b7fdbd3ede2bf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_fe65a31a0b6d493005850b91bec4d133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_e25183c1ba0704f4be0c74aa3c6c23e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_30111c1e91afb11ecdf93259f7ad76f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_6ecce2a969282b4dfa6fc67c5be1c9b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1163a30-464d-5c47-a90d-57103b6fd3c8/a1163a30-464d-5c47-a90d-57103b6fd3c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/4d/b24d24f76197de0a5dc4e0713416c083/pa/AT59438_b85efc635e8368d41cbe5cc9443c29b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT59438%27 HTTP/1.1" 200 None
2026-03-30 11:34:05 [auto1.be] INFO: Saving data for AT59438: {'created_time': 1774870445.335264, 'last_price_update_time': 1774870445.335277, 'auction_closing_time': 1774969264.0}
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AT59438') HTTP/1.1" 204 0
2026-03-30 11:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 with identifier: BA58536
2026-03-30 11:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 with identifier: BA58536
2026-03-30 11:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676 with identifier: BA58536 to the API
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '4.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:50:59Z',
 'fuel_type': 'diesel',
 'id': '3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA58536',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 162284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cfd2a4f70a5c8db66d4579eb1d402c2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0626dfcc4d94f15ad4741f093fe1e2d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_c939fd858b03259b7d40d2b4f64abf44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_2766ba4135826ccb15f71889ec73fe00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_0f710ea77be63b7d22f35a8d132245a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_b8596b882df02c0e9b215d72c1c9bbcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_a5cc38069f12a1aba9ac7638a1a1d363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_90cd745db96e895034b50767272673a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_27839071152b30a4d62753a46f22d652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676/3e6e2e7d-e638-5ec1-8ea7-0cf3325fc676_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/0e/8d0e3144000d4d65eb5143db7aadc9b8/pa/BA58536_cd18f01a55897b4e8c02db253e72d662.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-02-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Toyota Land Cruiser 4.2 Diesel HZJ 79 Pick-up',
 'transmission': 'manual',
 'trim': 'HZJ 79 Pick-up',
 'year': 2000}
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA58536%27 HTTP/1.1" 200 None
2026-03-30 11:34:05 [auto1.be] INFO: Saving data for BA58536: {'created_time': 1774870445.721923, 'last_price_update_time': 1774870445.721942, 'auction_closing_time': 1774972259.0}
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA58536') HTTP/1.1" 204 0
2026-03-30 11:34:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f6490>
2026-03-30 11:34:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252Fd1%252Ff6d128cc2e9537b04ffd1712418a6c17%252Fpa%252FNW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg saved to cache
2026-03-30 11:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4
2026-03-30 11:34:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 990341ce-974e-5e34-80d2-bc8b9f98d6d4, skipping ID generation
2026-03-30 11:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4 with scrape type 1
2026-03-30 11:34:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 990341ce-974e-5e34-80d2-bc8b9f98d6d4 sending to next pipeline
2026-03-30 11:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 990341ce-974e-5e34-80d2-bc8b9f98d6d4, identifier: NW05600
2026-03-30 11:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 990341ce-974e-5e34-80d2-bc8b9f98d6d4 with identifier: NW05600
2026-03-30 11:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 990341ce-974e-5e34-80d2-bc8b9f98d6d4 with identifier: NW05600
2026-03-30 11:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 990341ce-974e-5e34-80d2-bc8b9f98d6d4 with identifier: NW05600 to the API
2026-03-30 11:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:23:46Z',
 'fuel_type': 'diesel',
 'id': '990341ce-974e-5e34-80d2-bc8b9f98d6d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW05600',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 102139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_7e48d0e6072fbf3b883207efb829bdf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_c1f814c53b6307b3922bfb04feb4a84d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_dd6ab1b701b2727de656f0e0848cfe6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_e9825016180d47c0cd33816da643ae5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_cc8f155fb3513ea707df86bbb8bd98f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_0d258202994796b78a0ac150801f64c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_b6e2fab625a3747d83ea999c1ad5913b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_9b723e69077f0075e68259c9343a6888.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_634b6b97531f59e4af352f896b5aa183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_990341ce-974e-5e34-80d2-bc8b9f98d6d4/990341ce-974e-5e34-80d2-bc8b9f98d6d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/d1/f6d128cc2e9537b04ffd1712418a6c17/pa/NW05600_bddef4e6a059d3b8e3b0daa3e15606c7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW05600%27 HTTP/1.1" 200 None
2026-03-30 11:34:06 [auto1.be] INFO: Saving data for NW05600: {'created_time': 1774870446.469176, 'last_price_update_time': 1774870446.469186, 'auction_closing_time': 1774970626.0}
2026-03-30 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NW05600') HTTP/1.1" 204 0
2026-03-30 11:34:07 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 40 pages/min), scraped 46 items (at 24 items/min)
2026-03-30 11:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF54485> (referer: https://www.auto1.com/v1/car-details-view/TF54485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f53dda3-314b-539c-a5e5-1056b01fca68 with identifier: TF54485
2026-03-30 11:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f53dda3-314b-539c-a5e5-1056b01fca68 with scrape type 1
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_ce774bbef8d7cc09472fb37a44266055.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_ce774bbef8d7cc09472fb37a44266055.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_1d8e62e4d3c529bba3518937dab2bd9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_1d8e62e4d3c529bba3518937dab2bd9e.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_fa995ee45164a3203b0bfcca7cf4def5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_fa995ee45164a3203b0bfcca7cf4def5.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_292b1e77270c6dce1f76ddd701794f34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_292b1e77270c6dce1f76ddd701794f34.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_d047cba0586b94dbd66a9c0b08801c06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_d047cba0586b94dbd66a9c0b08801c06.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_9be634aba613ed1dd58e016df500a886.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9be634aba613ed1dd58e016df500a886.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_9f1f5a2b0d4b1cf3c582cd37a735df31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9f1f5a2b0d4b1cf3c582cd37a735df31.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_e16c918b3449c27730aee79e4ce8e0bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_e16c918b3449c27730aee79e4ce8e0bc.jpg not downloaded yet
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_f47dfa7cb7126d14a1ee1a08e6c86ee4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_f47dfa7cb7126d14a1ee1a08e6c86ee4.jpg not downloaded yet
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG30557> (referer: https://www.auto1.com/v1/car-details-view/SG30557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_f47dfa7cb7126d14a1ee1a08e6c86ee4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 934e8705-351d-56ba-b33f-5344f5945d26 with identifier: SG30557
2026-03-30 11:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934e8705-351d-56ba-b33f-5344f5945d26 with scrape type 1
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_0abad75c1ac40a81b75461ae937dfa20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0abad75c1ac40a81b75461ae937dfa20.jpg not downloaded yet
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_5b8146c834d81832625092fb4e5c30ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_5b8146c834d81832625092fb4e5c30ce.jpg not downloaded yet
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_947d33598d8ae4c957f3af55de34a861.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_947d33598d8ae4c957f3af55de34a861.jpg not downloaded yet
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP01808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_34369f384b85d756ccdc6800e83caaf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_34369f384b85d756ccdc6800e83caaf6.jpg not downloaded yet
2026-03-30 11:34:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_0868dcd2f9be2af790871e5ff33ce566.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0868dcd2f9be2af790871e5ff33ce566.jpg not downloaded yet
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_958c71dc4f33a59fb33db714139f9730.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_958c71dc4f33a59fb33db714139f9730.jpg not downloaded yet
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97ffc90>
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_f47dfa7cb7126d14a1ee1a08e6c86ee4.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_f47dfa7cb7126d14a1ee1a08e6c86ee4.jpg saved to cache
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_e16c918b3449c27730aee79e4ce8e0bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_f575d5820810ba4e1c5547b686b2ee2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_f575d5820810ba4e1c5547b686b2ee2a.jpg not downloaded yet
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_3d3ff71f2d166df791bc17b2d2af78de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_3d3ff71f2d166df791bc17b2d2af78de.jpg not downloaded yet
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_947d33598d8ae4c957f3af55de34a861.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_07d58d9dc9960f6aa8a203896fd65b8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_07d58d9dc9960f6aa8a203896fd65b8b.jpg not downloaded yet
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_da83d5900814cb6b6bd83f4d978e3753.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_da83d5900814cb6b6bd83f4d978e3753.jpg not downloaded yet
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea10dd10>
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_e16c918b3449c27730aee79e4ce8e0bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_e16c918b3449c27730aee79e4ce8e0bc.jpg saved to cache
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea11dd50>
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_947d33598d8ae4c957f3af55de34a861.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_947d33598d8ae4c957f3af55de34a861.jpg saved to cache
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_3d3ff71f2d166df791bc17b2d2af78de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_da83d5900814cb6b6bd83f4d978e3753.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9826550>
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_3d3ff71f2d166df791bc17b2d2af78de.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_3d3ff71f2d166df791bc17b2d2af78de.jpg saved to cache
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12fa50>
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_da83d5900814cb6b6bd83f4d978e3753.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_da83d5900814cb6b6bd83f4d978e3753.jpg saved to cache
2026-03-30 11:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_07d58d9dc9960f6aa8a203896fd65b8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB04209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97dee50>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_07d58d9dc9960f6aa8a203896fd65b8b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_07d58d9dc9960f6aa8a203896fd65b8b.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ66513> (referer: https://www.auto1.com/v1/car-details-view/TJ66513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK69889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_f575d5820810ba4e1c5547b686b2ee2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5227221-bc6a-56db-8e7d-b0a2974fc43d with identifier: TJ66513
2026-03-30 11:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5227221-bc6a-56db-8e7d-b0a2974fc43d with scrape type 1
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_cb95a51917a5b5746cadb494128268eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_cb95a51917a5b5746cadb494128268eb.jpg not downloaded yet
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_eae0311c9f397732802aaa222470251a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_eae0311c9f397732802aaa222470251a.jpg not downloaded yet
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg not downloaded yet
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_958c71dc4f33a59fb33db714139f9730.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_b22c190dd6b329217edaa2b2ab30cefb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_b22c190dd6b329217edaa2b2ab30cefb.jpg not downloaded yet
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_4f701d0b399dbe6794955b1ba8eb6a51.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_4f701d0b399dbe6794955b1ba8eb6a51.jpg not downloaded yet
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_1d6ac6ffbcdce5af61fe8731de944797.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_1d6ac6ffbcdce5af61fe8731de944797.jpg not downloaded yet
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_705c06b122654432c47408df239f28e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_705c06b122654432c47408df239f28e9.jpg not downloaded yet
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea132250>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_f575d5820810ba4e1c5547b686b2ee2a.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_f575d5820810ba4e1c5547b686b2ee2a.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_eae0311c9f397732802aaa222470251a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_28cb6bc7255512be93c26a24e40a16cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_28cb6bc7255512be93c26a24e40a16cc.jpg not downloaded yet
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0868dcd2f9be2af790871e5ff33ce566.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG99216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_8825d8649f73faa941dad15d33479a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_8825d8649f73faa941dad15d33479a95.jpg not downloaded yet
2026-03-30 11:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e979db50>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_958c71dc4f33a59fb33db714139f9730.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_958c71dc4f33a59fb33db714139f9730.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_d0ed66763831ed8308950c0f28d84629.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_d0ed66763831ed8308950c0f28d84629.jpg not downloaded yet
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_34369f384b85d756ccdc6800e83caaf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9841590>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_eae0311c9f397732802aaa222470251a.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_eae0311c9f397732802aaa222470251a.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_28cb6bc7255512be93c26a24e40a16cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_1d6ac6ffbcdce5af61fe8731de944797.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea147510>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_0868dcd2f9be2af790871e5ff33ce566.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0868dcd2f9be2af790871e5ff33ce566.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_705c06b122654432c47408df239f28e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975c5d0>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_34369f384b85d756ccdc6800e83caaf6.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_34369f384b85d756ccdc6800e83caaf6.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_8825d8649f73faa941dad15d33479a95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_d0ed66763831ed8308950c0f28d84629.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2196d0>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_28cb6bc7255512be93c26a24e40a16cc.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_28cb6bc7255512be93c26a24e40a16cc.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea11ded0>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_1d6ac6ffbcdce5af61fe8731de944797.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_1d6ac6ffbcdce5af61fe8731de944797.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_4f701d0b399dbe6794955b1ba8eb6a51.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975d450>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_705c06b122654432c47408df239f28e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_705c06b122654432c47408df239f28e9.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_b22c190dd6b329217edaa2b2ab30cefb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a6c90>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_8825d8649f73faa941dad15d33479a95.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_8825d8649f73faa941dad15d33479a95.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9845790>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_d0ed66763831ed8308950c0f28d84629.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_d0ed66763831ed8308950c0f28d84629.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_cb95a51917a5b5746cadb494128268eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9816e90>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_4f701d0b399dbe6794955b1ba8eb6a51.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_4f701d0b399dbe6794955b1ba8eb6a51.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea21f750>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_b22c190dd6b329217edaa2b2ab30cefb.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_b22c190dd6b329217edaa2b2ab30cefb.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_5b8146c834d81832625092fb4e5c30ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9743ad0>
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_cb95a51917a5b5746cadb494128268eb.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_cb95a51917a5b5746cadb494128268eb.jpg saved to cache
2026-03-30 11:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9f1f5a2b0d4b1cf3c582cd37a735df31.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9869c90>
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F2c%252F0c2cd20b710aec77ddd42417b13512cb%252Fpa%252FTJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg saved to cache
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5227221-bc6a-56db-8e7d-b0a2974fc43d
2026-03-30 11:34:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5227221-bc6a-56db-8e7d-b0a2974fc43d, skipping ID generation
2026-03-30 11:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5227221-bc6a-56db-8e7d-b0a2974fc43d with scrape type 1
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5227221-bc6a-56db-8e7d-b0a2974fc43d sending to next pipeline
2026-03-30 11:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5227221-bc6a-56db-8e7d-b0a2974fc43d, identifier: TJ66513
2026-03-30 11:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5227221-bc6a-56db-8e7d-b0a2974fc43d with identifier: TJ66513
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 11:34:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5227221-bc6a-56db-8e7d-b0a2974fc43d with identifier: TJ66513
2026-03-30 11:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5227221-bc6a-56db-8e7d-b0a2974fc43d with identifier: TJ66513 to the API
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:16:48Z',
 'fuel_type': 'gas',
 'id': 'c5227221-bc6a-56db-8e7d-b0a2974fc43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ66513',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 158072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_cb95a51917a5b5746cadb494128268eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_eae0311c9f397732802aaa222470251a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_14486ddbdff52f931cc6a6645dc543ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_b22c190dd6b329217edaa2b2ab30cefb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_4f701d0b399dbe6794955b1ba8eb6a51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_1d6ac6ffbcdce5af61fe8731de944797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_705c06b122654432c47408df239f28e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_28cb6bc7255512be93c26a24e40a16cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_8825d8649f73faa941dad15d33479a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5227221-bc6a-56db-8e7d-b0a2974fc43d/c5227221-bc6a-56db-8e7d-b0a2974fc43d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/2c/0c2cd20b710aec77ddd42417b13512cb/pa/TJ66513_d0ed66763831ed8308950c0f28d84629.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2021}
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ66513%27 HTTP/1.1" 200 None
2026-03-30 11:34:12 [auto1.be] INFO: Saving data for TJ66513: {'created_time': 1774870452.826067, 'last_price_update_time': 1774870452.826079, 'auction_closing_time': 1774970208.0}
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TJ66513') HTTP/1.1" 204 0
2026-03-30 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0abad75c1ac40a81b75461ae937dfa20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9be634aba613ed1dd58e016df500a886.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ69749> (referer: https://www.auto1.com/v1/car-details-view/DJ69749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea20dc10>
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_5b8146c834d81832625092fb4e5c30ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_5b8146c834d81832625092fb4e5c30ce.jpg saved to cache
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b3450>
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_9f1f5a2b0d4b1cf3c582cd37a735df31.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9f1f5a2b0d4b1cf3c582cd37a735df31.jpg saved to cache
2026-03-30 11:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b9e50>
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F21%252F4b21d3a0a80efdc595ea7e0a206b1950%252Fpa%252FSG30557_0abad75c1ac40a81b75461ae937dfa20.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0abad75c1ac40a81b75461ae937dfa20.jpg saved to cache
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 934e8705-351d-56ba-b33f-5344f5945d26
2026-03-30 11:34:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 934e8705-351d-56ba-b33f-5344f5945d26, skipping ID generation
2026-03-30 11:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934e8705-351d-56ba-b33f-5344f5945d26 with scrape type 1
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 934e8705-351d-56ba-b33f-5344f5945d26 sending to next pipeline
2026-03-30 11:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 934e8705-351d-56ba-b33f-5344f5945d26, identifier: SG30557
2026-03-30 11:34:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2f4c10>
2026-03-30 11:34:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_9be634aba613ed1dd58e016df500a886.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9be634aba613ed1dd58e016df500a886.jpg saved to cache
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:13 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1753 | hits on page: 40
2026-03-30 11:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 421cc83d-4c91-5b4f-9f21-58d9f143251e with identifier: DJ69749
2026-03-30 11:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 421cc83d-4c91-5b4f-9f21-58d9f143251e with scrape type 1
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 421cc83d-4c91-5b4f-9f21-58d9f143251e
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_78b0d164fb2128da9a95c100530df805.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_78b0d164fb2128da9a95c100530df805.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_47a6efb3e351e4d0e8ffa42df0b282c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_47a6efb3e351e4d0e8ffa42df0b282c8.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_8e125b932ab2343e9fd380ed7d2a9b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_8e125b932ab2343e9fd380ed7d2a9b54.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_27bd2b6b8d45d09dfd02043e7000b108.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_27bd2b6b8d45d09dfd02043e7000b108.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_0d7fc8b2c681a6dff3831f4da4236720.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_0d7fc8b2c681a6dff3831f4da4236720.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_c9834c7554f09e1d911466b9e3708977.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_c9834c7554f09e1d911466b9e3708977.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_3650e220d6d94678275a57a8ed06c262.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_3650e220d6d94678275a57a8ed06c262.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_610958b3a7dac55a6e269d11a0d03a85.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_610958b3a7dac55a6e269d11a0d03a85.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_b2b0021730cbfc7ead4669527607749f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_b2b0021730cbfc7ead4669527607749f.jpg already downloaded
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F00%252F9f008dbb8741b7fcd33a97b03ad206d1%252Fpa%252FDJ69749_bd43393d5c5a2124d1f3560657ff1bf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_bd43393d5c5a2124d1f3560657ff1bf4.jpg already downloaded
2026-03-30 11:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 421cc83d-4c91-5b4f-9f21-58d9f143251e, identifier: DJ69749
2026-03-30 11:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 934e8705-351d-56ba-b33f-5344f5945d26 with identifier: SG30557
2026-03-30 11:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 934e8705-351d-56ba-b33f-5344f5945d26 with identifier: SG30557
2026-03-30 11:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 934e8705-351d-56ba-b33f-5344f5945d26 with identifier: SG30557 to the API
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0abad75c1ac40a81b75461ae937dfa20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:21:06Z',
 'fuel_type': 'petrol',
 'id': '934e8705-351d-56ba-b33f-5344f5945d26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG30557',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 181819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0abad75c1ac40a81b75461ae937dfa20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_5b8146c834d81832625092fb4e5c30ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_947d33598d8ae4c957f3af55de34a861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_34369f384b85d756ccdc6800e83caaf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_0868dcd2f9be2af790871e5ff33ce566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_958c71dc4f33a59fb33db714139f9730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_f575d5820810ba4e1c5547b686b2ee2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_3d3ff71f2d166df791bc17b2d2af78de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_07d58d9dc9960f6aa8a203896fd65b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934e8705-351d-56ba-b33f-5344f5945d26/934e8705-351d-56ba-b33f-5344f5945d26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/21/4b21d3a0a80efdc595ea7e0a206b1950/pa/SG30557_da83d5900814cb6b6bd83f4d978e3753.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2015}
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG30557%27 HTTP/1.1" 200 None
2026-03-30 11:34:13 [auto1.be] INFO: Saving data for SG30557: {'created_time': 1774870453.860182, 'last_price_update_time': 1774870453.860195, 'auction_closing_time': 1774970466.0}
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG30557') HTTP/1.1" 204 0
2026-03-30 11:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 421cc83d-4c91-5b4f-9f21-58d9f143251e with identifier: DJ69749
2026-03-30 11:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 421cc83d-4c91-5b4f-9f21-58d9f143251e with identifier: DJ69749
2026-03-30 11:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 421cc83d-4c91-5b4f-9f21-58d9f143251e with identifier: DJ69749 to the API
2026-03-30 11:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ69749>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:18:29Z',
 'fuel_type': 'hybrid',
 'id': '421cc83d-4c91-5b4f-9f21-58d9f143251e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ69749',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 62252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_78b0d164fb2128da9a95c100530df805.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_47a6efb3e351e4d0e8ffa42df0b282c8.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_8e125b932ab2343e9fd380ed7d2a9b54.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_27bd2b6b8d45d09dfd02043e7000b108.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_0d7fc8b2c681a6dff3831f4da4236720.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_c9834c7554f09e1d911466b9e3708977.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_3650e220d6d94678275a57a8ed06c262.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_610958b3a7dac55a6e269d11a0d03a85.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_b2b0021730cbfc7ead4669527607749f.jpg',
                'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_bd43393d5c5a2124d1f3560657ff1bf4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_78b0d164fb2128da9a95c100530df805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_47a6efb3e351e4d0e8ffa42df0b282c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2347405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_8e125b932ab2343e9fd380ed7d2a9b54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2329541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_27bd2b6b8d45d09dfd02043e7000b108.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_0d7fc8b2c681a6dff3831f4da4236720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_c9834c7554f09e1d911466b9e3708977.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_3650e220d6d94678275a57a8ed06c262.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2423880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_610958b3a7dac55a6e269d11a0d03a85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_b2b0021730cbfc7ead4669527607749f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_421cc83d-4c91-5b4f-9f21-58d9f143251e/421cc83d-4c91-5b4f-9f21-58d9f143251e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2431935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/00/9f008dbb8741b7fcd33a97b03ad206d1/pa/DJ69749_bd43393d5c5a2124d1f3560657ff1bf4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ69749%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Saving data for DJ69749: {'created_time': 1774870454.214503, 'last_price_update_time': 1774870454.214513, 'auction_closing_time': 1774970309.0}
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ69749') HTTP/1.1" 204 0
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: PL66290
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: LV37866
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: PS84685
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS84685%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Scrape type for PS84685: 1
2026-03-30 11:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_292b1e77270c6dce1f76ddd701794f34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_d047cba0586b94dbd66a9c0b08801c06.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_fa995ee45164a3203b0bfcca7cf4def5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_1d8e62e4d3c529bba3518937dab2bd9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.822(s), this was the 1st time calling it.
2026-03-30 11:34:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.411313283472679 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:34:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.842(s), this was the 1st time calling it.
2026-03-30 11:34:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.7759316645847845 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: WZ45514
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: AU19337
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU19337%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Scrape type for AU19337: 1
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: WW90650
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW90650%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Scrape type for WW90650: 1
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: WN16756
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN16756%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Scrape type for WN16756: 1
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: PA70218
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: HX60509
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX60509%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Scrape type for HX60509: 2
2026-03-30 11:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b87032-e708-5dd7-bc70-a60bb2170267 with identifier: HX60509
2026-03-30 11:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b87032-e708-5dd7-bc70-a60bb2170267 with scrape type 2
2026-03-30 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b87032-e708-5dd7-bc70-a60bb2170267 with scrape type 2
2026-03-30 11:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71b87032-e708-5dd7-bc70-a60bb2170267, identifier: HX60509
2026-03-30 11:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71b87032-e708-5dd7-bc70-a60bb2170267 with identifier: HX60509
2026-03-30 11:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71b87032-e708-5dd7-bc70-a60bb2170267 with identifier: HX60509
2026-03-30 11:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71b87032-e708-5dd7-bc70-a60bb2170267 with identifier: HX60509 to the API
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:33:51Z',
 'fuel_type': 'diesel',
 'id': '71b87032-e708-5dd7-bc70-a60bb2170267',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX60509',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 113579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'BMW 3er 330d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX60509%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Saving data for HX60509: {'auction_closing_time': 1774971231.0, 'created_time': 1773693894.684567, 'last_price_update_time': 1774870454.750796}
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX60509') HTTP/1.1" 204 0
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: SB33640
2026-03-30 11:34:14 [auto1.be] INFO: Found listing with ID: EU93857
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU93857%27 HTTP/1.1" 200 None
2026-03-30 11:34:14 [auto1.be] INFO: Scrape type for EU93857: 1
2026-03-30 11:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_ce774bbef8d7cc09472fb37a44266055.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e5190>
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_292b1e77270c6dce1f76ddd701794f34.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_292b1e77270c6dce1f76ddd701794f34.jpg saved to cache
2026-03-30 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97773d0>
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_d047cba0586b94dbd66a9c0b08801c06.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_d047cba0586b94dbd66a9c0b08801c06.jpg saved to cache
2026-03-30 11:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e959fe50>
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_fa995ee45164a3203b0bfcca7cf4def5.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_fa995ee45164a3203b0bfcca7cf4def5.jpg saved to cache
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e3f90>
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_1d8e62e4d3c529bba3518937dab2bd9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_1d8e62e4d3c529bba3518937dab2bd9e.jpg saved to cache
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: ES88444
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: LP81056
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: PT40998
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: RN29378
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN29378%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Scrape type for RN29378: 1
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: EB14047
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB14047%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Scrape type for EB14047: 1
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Scrape type for HJ12403: 2
2026-03-30 11:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403
2026-03-30 11:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with scrape type 2
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with scrape type 2
2026-03-30 11:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a, identifier: HJ12403
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9786910>
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_ce774bbef8d7cc09472fb37a44266055.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_ce774bbef8d7cc09472fb37a44266055.jpg saved to cache
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403
2026-03-30 11:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403
2026-03-30 11:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a8bdbec-aa77-5ef7-93cf-bad4a183d31a with identifier: HJ12403 to the API
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:22:20Z',
 'fuel_type': 'hybrid',
 'id': '2a8bdbec-aa77-5ef7-93cf-bad4a183d31a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ12403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 219401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Saving data for HJ12403: {'auction_closing_time': 1774970540.0, 'created_time': 1773301638.532618, 'last_price_update_time': 1774870455.593178}
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ12403') HTTP/1.1" 204 0
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: WG16192
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG16192%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Scrape type for WG16192: 1
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: GZ79975
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ79975%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Scrape type for GZ79975: 1
2026-03-30 11:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL30986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB18656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9869550>
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F47%252Fcb4775210f405612e60314efbfcecb3f%252Fpa%252FTF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg saved to cache
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f53dda3-314b-539c-a5e5-1056b01fca68
2026-03-30 11:34:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f53dda3-314b-539c-a5e5-1056b01fca68, skipping ID generation
2026-03-30 11:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f53dda3-314b-539c-a5e5-1056b01fca68 with scrape type 1
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f53dda3-314b-539c-a5e5-1056b01fca68 sending to next pipeline
2026-03-30 11:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f53dda3-314b-539c-a5e5-1056b01fca68, identifier: TF54485
2026-03-30 11:34:15 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-30 11:34:15 [auto1.be] INFO: Scrape type for GS05656: 2
2026-03-30 11:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656
2026-03-30 11:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da410cd-de73-59af-9c8f-38fd81dd8b09 with scrape type 2
2026-03-30 11:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da410cd-de73-59af-9c8f-38fd81dd8b09 with scrape type 2
2026-03-30 11:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4da410cd-de73-59af-9c8f-38fd81dd8b09, identifier: GS05656
2026-03-30 11:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f53dda3-314b-539c-a5e5-1056b01fca68 with identifier: TF54485
2026-03-30 11:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f53dda3-314b-539c-a5e5-1056b01fca68 with identifier: TF54485
2026-03-30 11:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f53dda3-314b-539c-a5e5-1056b01fca68 with identifier: TF54485 to the API
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:54:13Z',
 'fuel_type': 'diesel',
 'id': '4f53dda3-314b-539c-a5e5-1056b01fca68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF54485',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 235933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_ce774bbef8d7cc09472fb37a44266055.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9cbbfcfd0cf945710627b14de25ee44a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_1d8e62e4d3c529bba3518937dab2bd9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_fa995ee45164a3203b0bfcca7cf4def5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_292b1e77270c6dce1f76ddd701794f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_d047cba0586b94dbd66a9c0b08801c06.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9be634aba613ed1dd58e016df500a886.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_9f1f5a2b0d4b1cf3c582cd37a735df31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_e16c918b3449c27730aee79e4ce8e0bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f53dda3-314b-539c-a5e5-1056b01fca68/4f53dda3-314b-539c-a5e5-1056b01fca68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/47/cb4775210f405612e60314efbfcecb3f/pa/TF54485_f47dfa7cb7126d14a1ee1a08e6c86ee4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 JTD Multijet',
 'transmission': 'manual',
 'trim': 'Multijet',
 'year': 2004}
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF54485%27 HTTP/1.1" 200 None
2026-03-30 11:34:16 [auto1.be] INFO: Saving data for TF54485: {'created_time': 1774870456.285992, 'last_price_update_time': 1774870456.286005, 'auction_closing_time': 1774972453.0}
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF54485') HTTP/1.1" 204 0
2026-03-30 11:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656
2026-03-30 11:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656
2026-03-30 11:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4da410cd-de73-59af-9c8f-38fd81dd8b09 with identifier: GS05656 to the API
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:29:29Z',
 'fuel_type': 'diesel',
 'id': '4da410cd-de73-59af-9c8f-38fd81dd8b09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS05656',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 219902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-23',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-30 11:34:16 [auto1.be] INFO: Saving data for GS05656: {'auction_closing_time': 1774970969.0, 'created_time': 1773134346.379088, 'last_price_update_time': 1774870456.815112}
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS05656') HTTP/1.1" 204 0
2026-03-30 11:34:16 [auto1.be] INFO: Found listing with ID: ZG35997
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG35997%27 HTTP/1.1" 200 None
2026-03-30 11:34:16 [auto1.be] INFO: Scrape type for ZG35997: 2
2026-03-30 11:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5073bb-27ca-597d-8a21-29e7b1687ba7 with identifier: ZG35997
2026-03-30 11:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5073bb-27ca-597d-8a21-29e7b1687ba7 with scrape type 2
2026-03-30 11:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5073bb-27ca-597d-8a21-29e7b1687ba7 with scrape type 2
2026-03-30 11:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a5073bb-27ca-597d-8a21-29e7b1687ba7, identifier: ZG35997
2026-03-30 11:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a5073bb-27ca-597d-8a21-29e7b1687ba7 with identifier: ZG35997
2026-03-30 11:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a5073bb-27ca-597d-8a21-29e7b1687ba7 with identifier: ZG35997
2026-03-30 11:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a5073bb-27ca-597d-8a21-29e7b1687ba7 with identifier: ZG35997 to the API
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:59:03Z',
 'fuel_type': 'petrol',
 'id': '0a5073bb-27ca-597d-8a21-29e7b1687ba7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG35997',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 10301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-16',
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid North Star FWD',
 'transmission': 'automatic',
 'trim': 'North Star FWD',
 'year': 2024}
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG35997%27 HTTP/1.1" 200 None
2026-03-30 11:34:17 [auto1.be] INFO: Saving data for ZG35997: {'auction_closing_time': 1774972743.0, 'created_time': 1773661822.075884, 'last_price_update_time': 1774870457.264514}
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG35997') HTTP/1.1" 204 0
2026-03-30 11:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU92557> (referer: https://www.auto1.com/v1/car-details-view/TU92557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: PV60637
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV60637%27 HTTP/1.1" 200 None
2026-03-30 11:34:17 [auto1.be] INFO: Scrape type for PV60637: 2
2026-03-30 11:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82e13c1-8a9f-5432-ae32-1eead1cb5fe7 with identifier: PV60637
2026-03-30 11:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82e13c1-8a9f-5432-ae32-1eead1cb5fe7 with scrape type 2
2026-03-30 11:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b82e13c1-8a9f-5432-ae32-1eead1cb5fe7 with scrape type 2
2026-03-30 11:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b82e13c1-8a9f-5432-ae32-1eead1cb5fe7, identifier: PV60637
2026-03-30 11:34:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b82e13c1-8a9f-5432-ae32-1eead1cb5fe7 with identifier: PV60637
2026-03-30 11:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b82e13c1-8a9f-5432-ae32-1eead1cb5fe7 with identifier: PV60637
2026-03-30 11:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b82e13c1-8a9f-5432-ae32-1eead1cb5fe7 with identifier: PV60637 to the API
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:45:26Z',
 'fuel_type': 'diesel',
 'id': 'b82e13c1-8a9f-5432-ae32-1eead1cb5fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV60637',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 159914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi Creative Blue 2WD',
 'transmission': 'manual',
 'trim': 'Creative Blue 2WD',
 'year': 2015}
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV60637%27 HTTP/1.1" 200 None
2026-03-30 11:34:17 [auto1.be] INFO: Saving data for PV60637: {'auction_closing_time': 1774971926.0, 'created_time': 1774298139.188491, 'last_price_update_time': 1774870457.723567}
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV60637') HTTP/1.1" 204 0
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: LP17149
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: PD12603
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: FF72593
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF72593%27 HTTP/1.1" 200 None
2026-03-30 11:34:17 [auto1.be] INFO: Scrape type for FF72593: 1
2026-03-30 11:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53db3876-5e15-5b3f-8263-36167aa7afb0 with identifier: TU92557
2026-03-30 11:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53db3876-5e15-5b3f-8263-36167aa7afb0 with scrape type 1
2026-03-30 11:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_5adcb18c0c1423199996231f9a728a0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_5adcb18c0c1423199996231f9a728a0b.jpg not downloaded yet
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: MW08059
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: RV85346
2026-03-30 11:34:17 [auto1.be] INFO: Found listing with ID: KM33762
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM33762%27 HTTP/1.1" 200 None
2026-03-30 11:34:17 [auto1.be] INFO: Scrape type for KM33762: 2
2026-03-30 11:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 008841bc-e39e-5f78-8a32-32a02c43ca25 with identifier: KM33762
2026-03-30 11:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 008841bc-e39e-5f78-8a32-32a02c43ca25 with scrape type 2
2026-03-30 11:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 008841bc-e39e-5f78-8a32-32a02c43ca25 with scrape type 2
2026-03-30 11:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 008841bc-e39e-5f78-8a32-32a02c43ca25, identifier: KM33762
2026-03-30 11:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 008841bc-e39e-5f78-8a32-32a02c43ca25 with identifier: KM33762
2026-03-30 11:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 008841bc-e39e-5f78-8a32-32a02c43ca25 with identifier: KM33762
2026-03-30 11:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 008841bc-e39e-5f78-8a32-32a02c43ca25 with identifier: KM33762 to the API
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 442,
 'expiration_date': '2026-03-31T15:00:09Z',
 'fuel_type': 'hybrid',
 'id': '008841bc-e39e-5f78-8a32-32a02c43ca25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM33762',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 132881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 500e 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM33762%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [auto1.be] INFO: Saving data for KM33762: {'auction_closing_time': 1774969209.0, 'created_time': 1774297903.254004, 'last_price_update_time': 1774870458.29254}
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM33762') HTTP/1.1" 204 0
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_3db5d49331d356e82492cac2d3906a77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_3db5d49331d356e82492cac2d3906a77.jpg not downloaded yet
2026-03-30 11:34:18 [auto1.be] INFO: Found listing with ID: SC48774
2026-03-30 11:34:18 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [auto1.be] INFO: Scrape type for HE19111: 2
2026-03-30 11:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111
2026-03-30 11:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12603997-a459-5057-9b27-a7d3c7aeeb8a with scrape type 2
2026-03-30 11:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12603997-a459-5057-9b27-a7d3c7aeeb8a with scrape type 2
2026-03-30 11:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12603997-a459-5057-9b27-a7d3c7aeeb8a, identifier: HE19111
2026-03-30 11:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:34:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111
2026-03-30 11:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12603997-a459-5057-9b27-a7d3c7aeeb8a with identifier: HE19111 to the API
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:40:36Z',
 'fuel_type': 'petrol',
 'id': '12603997-a459-5057-9b27-a7d3c7aeeb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE19111',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 107066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-23',
 'seller_name': None,
 'title': 'BMW 3er 320i EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2013}
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [auto1.be] INFO: Saving data for HE19111: {'auction_closing_time': 1774971636.0, 'created_time': 1773134622.131033, 'last_price_update_time': 1774870458.901527}
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE19111') HTTP/1.1" 204 0
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_330aef6f43d07bdb42cbfc9359759f5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_330aef6f43d07bdb42cbfc9359759f5e.jpg not downloaded yet
2026-03-30 11:34:18 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-30 11:34:18 [auto1.be] INFO: Found listing with ID: ZN07894
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN07894%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [auto1.be] INFO: Scrape type for ZN07894: 1
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_98943e7a0151094173699f61f6dcbbed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_98943e7a0151094173699f61f6dcbbed.jpg not downloaded yet
2026-03-30 11:34:18 [auto1.be] INFO: Found listing with ID: LM52294
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM52294%27 HTTP/1.1" 200 None
2026-03-30 11:34:18 [auto1.be] INFO: Scrape type for LM52294: 1
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_4248ff05796081d2e71e8b8ea1bf132b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_4248ff05796081d2e71e8b8ea1bf132b.jpg not downloaded yet
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: ST95230
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: AL22042
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL22042%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [auto1.be] INFO: Scrape type for AL22042: 1
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_8f01c32e86f22639efa4fe59d0980eb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_8f01c32e86f22639efa4fe59d0980eb1.jpg not downloaded yet
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: FN89507
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN89507%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [auto1.be] INFO: Scrape type for FN89507: 1
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_0f5b6c60dced0c604f7fd8707d82ee47.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0f5b6c60dced0c604f7fd8707d82ee47.jpg not downloaded yet
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: EK78236
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK78236%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [auto1.be] INFO: Scrape type for EK78236: 1
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_01f7d72c856b1e7ed7424d61b9b33562.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_01f7d72c856b1e7ed7424d61b9b33562.jpg not downloaded yet
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: WC26053
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC26053%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [auto1.be] INFO: Scrape type for WC26053: 1
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_0cf89682f13f5acfdf1f8ec94bbc417e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0cf89682f13f5acfdf1f8ec94bbc417e.jpg not downloaded yet
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: HW43173
2026-03-30 11:34:19 [auto1.be] INFO: Found listing with ID: LD88636
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD88636%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [auto1.be] INFO: Scrape type for LD88636: 1
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_33eaa0471d9b22a682786225f57cb38c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_33eaa0471d9b22a682786225f57cb38c.jpg not downloaded yet
2026-03-30 11:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB04209> (referer: https://www.auto1.com/v1/car-details-view/AB04209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP01808> (referer: https://www.auto1.com/v1/car-details-view/AP01808/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bcfef0f-626a-5ec3-bd0a-a1b615846599 with identifier: AB04209
2026-03-30 11:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599 with scrape type 1
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_68425bcaf8c329191c69c70ca0308970.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_68425bcaf8c329191c69c70ca0308970.jpg not downloaded yet
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_910b6a52a05dd92ea34bf1a338be4a17.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_910b6a52a05dd92ea34bf1a338be4a17.jpg not downloaded yet
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_24760ee780d43af027ae102949cd6687.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_24760ee780d43af027ae102949cd6687.jpg not downloaded yet
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_b572c6831e1392d7b51d82864c0d571b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b572c6831e1392d7b51d82864c0d571b.jpg not downloaded yet
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_44c9ec8a4084889ec0f6ba034b2c8379.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_44c9ec8a4084889ec0f6ba034b2c8379.jpg not downloaded yet
2026-03-30 11:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_33eaa0471d9b22a682786225f57cb38c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_b3a8ea6ce62797714b88a5d35e3ef7af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b3a8ea6ce62797714b88a5d35e3ef7af.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_ecf4324669b4dc725537d23f46751f2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_ecf4324669b4dc725537d23f46751f2f.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_038ca3c60c0ff9ac9635697efe93fd0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_038ca3c60c0ff9ac9635697efe93fd0a.jpg not downloaded yet
2026-03-30 11:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ebf58b-d21d-5715-b1b0-a318cfc76e47 with identifier: AP01808
2026-03-30 11:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47 with scrape type 1
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_2472dd5aeae67c1a4b9b26855c440c7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_2472dd5aeae67c1a4b9b26855c440c7d.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_9b6a467ec57565fe8980d7f743fd6904.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b6a467ec57565fe8980d7f743fd6904.jpg not downloaded yet
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9868ad0>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_33eaa0471d9b22a682786225f57cb38c.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_33eaa0471d9b22a682786225f57cb38c.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_aa345ef83e77454a1e11f04eab400006.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_aa345ef83e77454a1e11f04eab400006.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_ccde5227bd76d5fa4ad01fe81c18c8ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_ccde5227bd76d5fa4ad01fe81c18c8ca.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_9b02602ea926733af0ce63b5decb4a0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b02602ea926733af0ce63b5decb4a0b.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_a83e46e405d2ccb331e0a9ac7ea1427b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_a83e46e405d2ccb331e0a9ac7ea1427b.jpg not downloaded yet
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_e342a64419fb2339ecce41d6417f1248.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_e342a64419fb2339ecce41d6417f1248.jpg not downloaded yet
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_44c9ec8a4084889ec0f6ba034b2c8379.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_e342a64419fb2339ecce41d6417f1248.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f5690>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_44c9ec8a4084889ec0f6ba034b2c8379.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_44c9ec8a4084889ec0f6ba034b2c8379.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_a83e46e405d2ccb331e0a9ac7ea1427b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea21ab90>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_e342a64419fb2339ecce41d6417f1248.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_e342a64419fb2339ecce41d6417f1248.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b02602ea926733af0ce63b5decb4a0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975bd10>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_a83e46e405d2ccb331e0a9ac7ea1427b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_a83e46e405d2ccb331e0a9ac7ea1427b.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_ccde5227bd76d5fa4ad01fe81c18c8ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f59d0>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_9b02602ea926733af0ce63b5decb4a0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b02602ea926733af0ce63b5decb4a0b.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_aa345ef83e77454a1e11f04eab400006.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e8690>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_ccde5227bd76d5fa4ad01fe81c18c8ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_ccde5227bd76d5fa4ad01fe81c18c8ca.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b6a467ec57565fe8980d7f743fd6904.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96da710>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_aa345ef83e77454a1e11f04eab400006.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_aa345ef83e77454a1e11f04eab400006.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2ea910>
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_9b6a467ec57565fe8980d7f743fd6904.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b6a467ec57565fe8980d7f743fd6904.jpg saved to cache
2026-03-30 11:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_2472dd5aeae67c1a4b9b26855c440c7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e76d0>
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_2472dd5aeae67c1a4b9b26855c440c7d.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_2472dd5aeae67c1a4b9b26855c440c7d.jpg saved to cache
2026-03-30 11:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9759a50>
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F72%252F1472dc4b3988c4350e07e401d3de24f7%252Fpa%252FAP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg saved to cache
2026-03-30 11:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47
2026-03-30 11:34:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06ebf58b-d21d-5715-b1b0-a318cfc76e47, skipping ID generation
2026-03-30 11:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47 with scrape type 1
2026-03-30 11:34:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06ebf58b-d21d-5715-b1b0-a318cfc76e47 sending to next pipeline
2026-03-30 11:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 06ebf58b-d21d-5715-b1b0-a318cfc76e47, identifier: AP01808
2026-03-30 11:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 06ebf58b-d21d-5715-b1b0-a318cfc76e47 with identifier: AP01808
2026-03-30 11:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 06ebf58b-d21d-5715-b1b0-a318cfc76e47 with identifier: AP01808
2026-03-30 11:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 06ebf58b-d21d-5715-b1b0-a318cfc76e47 with identifier: AP01808 to the API
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:42:46Z',
 'fuel_type': 'diesel',
 'id': '06ebf58b-d21d-5715-b1b0-a318cfc76e47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP01808',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'BMW',
 'model': '1er',
 'odometer': 205804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_215f9c2dc46264606cb0dd26a8c92cd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b6a467ec57565fe8980d7f743fd6904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_ccde5227bd76d5fa4ad01fe81c18c8ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_9b02602ea926733af0ce63b5decb4a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_a83e46e405d2ccb331e0a9ac7ea1427b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ebf58b-d21d-5715-b1b0-a318cfc76e47/06ebf58b-d21d-5715-b1b0-a318cfc76e47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/72/1472dc4b3988c4350e07e401d3de24f7/pa/AP01808_e342a64419fb2339ecce41d6417f1248.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP01808%27 HTTP/1.1" 200 None
2026-03-30 11:34:21 [auto1.be] INFO: Saving data for AP01808: {'created_time': 1774870461.810219, 'last_price_update_time': 1774870461.81023, 'auction_closing_time': 1774971766.0}
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP01808') HTTP/1.1" 204 0
2026-03-30 11:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_038ca3c60c0ff9ac9635697efe93fd0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ81291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.163(s), this was the 1st time calling it.
2026-03-30 11:34:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.531568453860237 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e08d0>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_038ca3c60c0ff9ac9635697efe93fd0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_038ca3c60c0ff9ac9635697efe93fd0a.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_ecf4324669b4dc725537d23f46751f2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b3a8ea6ce62797714b88a5d35e3ef7af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96eb350>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_ecf4324669b4dc725537d23f46751f2f.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_ecf4324669b4dc725537d23f46751f2f.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e1c50>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_b3a8ea6ce62797714b88a5d35e3ef7af.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b3a8ea6ce62797714b88a5d35e3ef7af.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b572c6831e1392d7b51d82864c0d571b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96eb2d0>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_b572c6831e1392d7b51d82864c0d571b.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b572c6831e1392d7b51d82864c0d571b.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_24760ee780d43af027ae102949cd6687.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_910b6a52a05dd92ea34bf1a338be4a17.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cec50>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_24760ee780d43af027ae102949cd6687.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_24760ee780d43af027ae102949cd6687.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_68425bcaf8c329191c69c70ca0308970.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e8690>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_910b6a52a05dd92ea34bf1a338be4a17.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_910b6a52a05dd92ea34bf1a338be4a17.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b3910>
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe7%252F0ee76b977c8a9ea18896365432d4dc28%252Fpa%252FAB04209_68425bcaf8c329191c69c70ca0308970.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_68425bcaf8c329191c69c70ca0308970.jpg saved to cache
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599
2026-03-30 11:34:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bcfef0f-626a-5ec3-bd0a-a1b615846599, skipping ID generation
2026-03-30 11:34:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599 with scrape type 1
2026-03-30 11:34:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bcfef0f-626a-5ec3-bd0a-a1b615846599 sending to next pipeline
2026-03-30 11:34:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5bcfef0f-626a-5ec3-bd0a-a1b615846599, identifier: AB04209
2026-03-30 11:34:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5bcfef0f-626a-5ec3-bd0a-a1b615846599 with identifier: AB04209
2026-03-30 11:34:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5bcfef0f-626a-5ec3-bd0a-a1b615846599 with identifier: AB04209
2026-03-30 11:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5bcfef0f-626a-5ec3-bd0a-a1b615846599 with identifier: AB04209 to the API
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_68425bcaf8c329191c69c70ca0308970.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:37:55Z',
 'fuel_type': 'diesel',
 'id': '5bcfef0f-626a-5ec3-bd0a-a1b615846599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB04209',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 205697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_68425bcaf8c329191c69c70ca0308970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_910b6a52a05dd92ea34bf1a338be4a17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_24760ee780d43af027ae102949cd6687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b572c6831e1392d7b51d82864c0d571b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_44c9ec8a4084889ec0f6ba034b2c8379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_b3a8ea6ce62797714b88a5d35e3ef7af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_ecf4324669b4dc725537d23f46751f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_038ca3c60c0ff9ac9635697efe93fd0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_2472dd5aeae67c1a4b9b26855c440c7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bcfef0f-626a-5ec3-bd0a-a1b615846599/5bcfef0f-626a-5ec3-bd0a-a1b615846599_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e7/0ee76b977c8a9ea18896365432d4dc28/pa/AB04209_aa345ef83e77454a1e11f04eab400006.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2020}
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB04209%27 HTTP/1.1" 200 None
2026-03-30 11:34:23 [auto1.be] INFO: Saving data for AB04209: {'created_time': 1774870463.268421, 'last_price_update_time': 1774870463.268432, 'auction_closing_time': 1774971475.0}
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB04209') HTTP/1.1" 204 0
2026-03-30 11:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0cf89682f13f5acfdf1f8ec94bbc417e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea219a90>
2026-03-30 11:34:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_0cf89682f13f5acfdf1f8ec94bbc417e.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0cf89682f13f5acfdf1f8ec94bbc417e.jpg saved to cache
2026-03-30 11:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:24 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1753 | hits on page: 40
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: WK88791
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: SY31079
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY31079%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for SY31079: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: XK60996
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: EY10486
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY10486%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for EY10486: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: ZH36380
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH36380%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for ZH36380: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: XD24898
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD24898%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for XD24898: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: ES37809
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES37809%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for ES37809: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: BP63319
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: PJ76260
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: XD22727
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: SM25076
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM25076%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for SM25076: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: SW30540
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW30540%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for SW30540: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: EV96018
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV96018%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for EV96018: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: VC77463
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC77463%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for VC77463: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: LX71695
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX71695%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for LX71695: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: TS39251
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: SG06141
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: GH31708
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH31708%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for GH31708: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: FK55649
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK55649%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for FK55649: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: XS95639
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS95639%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for XS95639: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: MK43938
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: CL15849
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: GA37165
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA37165%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for GA37165: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: JH66353
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH66353%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for JH66353: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: AS78101
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: CV32851
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: AA45434
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: SF91035
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: HA52655
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA52655%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for HA52655: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: MP60001
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: JZ66091
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: TC22356
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC22356%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for TC22356: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: FX96878
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FX96878%27 HTTP/1.1" 200 None
2026-03-30 11:34:24 [auto1.be] INFO: Scrape type for FX96878: 1
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: AP57760
2026-03-30 11:34:24 [auto1.be] INFO: Found listing with ID: KX38025
2026-03-30 11:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_01f7d72c856b1e7ed7424d61b9b33562.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:34:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9869d90>
2026-03-30 11:34:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_01f7d72c856b1e7ed7424d61b9b33562.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_01f7d72c856b1e7ed7424d61b9b33562.jpg saved to cache
2026-03-30 11:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:34:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF68102> (referer: https://www.auto1.com/v1/car-details-view/RF68102/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18739eb8-442c-58a7-a292-35a2d8279bda with identifier: RF68102
2026-03-30 11:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18739eb8-442c-58a7-a292-35a2d8279bda with scrape type 1
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_7974bc28757fb17d33c0d3afe97b6beb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7974bc28757fb17d33c0d3afe97b6beb.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_7df00998764201127811ad2cd95f066a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7df00998764201127811ad2cd95f066a.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_dfb13143443843c32f9f3854f9a4c1a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_dfb13143443843c32f9f3854f9a4c1a5.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_de5d4dff668ee13720c04fc6997416f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_de5d4dff668ee13720c04fc6997416f9.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_885fe3186bd3900f27e61b5c8f6cc1f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_885fe3186bd3900f27e61b5c8f6cc1f7.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_0a497b4c0643b87aef6f018a1cf18296.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_0a497b4c0643b87aef6f018a1cf18296.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_58390a8bbef0f0709a9f2caa4ee7f373.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_58390a8bbef0f0709a9f2caa4ee7f373.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_6c09885ebcf3899e7a4c4b1532f006e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_6c09885ebcf3899e7a4c4b1532f006e1.jpg not downloaded yet
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_33d0accc51b88b25cbcee66090dbc3ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_33d0accc51b88b25cbcee66090dbc3ba.jpg not downloaded yet
2026-03-30 11:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL07938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_33d0accc51b88b25cbcee66090dbc3ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981a9d0>
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_33d0accc51b88b25cbcee66090dbc3ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_33d0accc51b88b25cbcee66090dbc3ba.jpg saved to cache
2026-03-30 11:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_6c09885ebcf3899e7a4c4b1532f006e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a42d0>
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_6c09885ebcf3899e7a4c4b1532f006e1.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_6c09885ebcf3899e7a4c4b1532f006e1.jpg saved to cache
2026-03-30 11:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC96968> (referer: https://www.auto1.com/v1/car-details-view/EC96968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26977dfa-fcd7-5cad-8cce-6bb17651f093 with identifier: EC96968
2026-03-30 11:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26977dfa-fcd7-5cad-8cce-6bb17651f093 with scrape type 1
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_9ad1a7ef67f8737194c323858a811f74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_9ad1a7ef67f8737194c323858a811f74.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_4419e822db880ac3c38980d97c8a8682.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4419e822db880ac3c38980d97c8a8682.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_fe90bfa46548dd3fe05ab6d9cde74e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_fe90bfa46548dd3fe05ab6d9cde74e56.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_6aeedafcf7c8f61c63ff5a423c061633.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_6aeedafcf7c8f61c63ff5a423c061633.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_145ed244d0147419969aa01ecd9c6082.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_145ed244d0147419969aa01ecd9c6082.jpg not downloaded yet
2026-03-30 11:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_58390a8bbef0f0709a9f2caa4ee7f373.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_5aa6e2cd3614124c39b124250afd881f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_5aa6e2cd3614124c39b124250afd881f.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_bfe50b56e372fd156de8219753da5709.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_bfe50b56e372fd156de8219753da5709.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_4fd7c8be033f0b2cc58e602b6642a644.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4fd7c8be033f0b2cc58e602b6642a644.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_cd00e8479dd85acb7287ea2d8ffa46cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_cd00e8479dd85acb7287ea2d8ffa46cc.jpg not downloaded yet
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_b77cc78a3dce9e6ee83d019faf3fbf08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_b77cc78a3dce9e6ee83d019faf3fbf08.jpg not downloaded yet
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea216790>
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_58390a8bbef0f0709a9f2caa4ee7f373.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_58390a8bbef0f0709a9f2caa4ee7f373.jpg saved to cache
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_145ed244d0147419969aa01ecd9c6082.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea101810>
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_145ed244d0147419969aa01ecd9c6082.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_145ed244d0147419969aa01ecd9c6082.jpg saved to cache
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_b77cc78a3dce9e6ee83d019faf3fbf08.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9767790>
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_b77cc78a3dce9e6ee83d019faf3fbf08.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_b77cc78a3dce9e6ee83d019faf3fbf08.jpg saved to cache
2026-03-30 11:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_cd00e8479dd85acb7287ea2d8ffa46cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e9ad0>
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_cd00e8479dd85acb7287ea2d8ffa46cc.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_cd00e8479dd85acb7287ea2d8ffa46cc.jpg saved to cache
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4fd7c8be033f0b2cc58e602b6642a644.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9819110>
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_4fd7c8be033f0b2cc58e602b6642a644.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4fd7c8be033f0b2cc58e602b6642a644.jpg saved to cache
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_bfe50b56e372fd156de8219753da5709.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea133850>
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_bfe50b56e372fd156de8219753da5709.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_bfe50b56e372fd156de8219753da5709.jpg saved to cache
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_5aa6e2cd3614124c39b124250afd881f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9817050>
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_5aa6e2cd3614124c39b124250afd881f.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_5aa6e2cd3614124c39b124250afd881f.jpg saved to cache
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_6aeedafcf7c8f61c63ff5a423c061633.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea217f10>
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_6aeedafcf7c8f61c63ff5a423c061633.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_6aeedafcf7c8f61c63ff5a423c061633.jpg saved to cache
2026-03-30 11:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_fe90bfa46548dd3fe05ab6d9cde74e56.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9823fd0>
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_fe90bfa46548dd3fe05ab6d9cde74e56.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_fe90bfa46548dd3fe05ab6d9cde74e56.jpg saved to cache
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4419e822db880ac3c38980d97c8a8682.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_9ad1a7ef67f8737194c323858a811f74.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0bed50>
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_4419e822db880ac3c38980d97c8a8682.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4419e822db880ac3c38980d97c8a8682.jpg saved to cache
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e974ad90>
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252Fab%252Fefabcd5fd560bb6f261f969a3f9f4d52%252Fpa%252FEC96968_9ad1a7ef67f8737194c323858a811f74.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_9ad1a7ef67f8737194c323858a811f74.jpg saved to cache
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26977dfa-fcd7-5cad-8cce-6bb17651f093
2026-03-30 11:34:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26977dfa-fcd7-5cad-8cce-6bb17651f093, skipping ID generation
2026-03-30 11:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26977dfa-fcd7-5cad-8cce-6bb17651f093 with scrape type 1
2026-03-30 11:34:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26977dfa-fcd7-5cad-8cce-6bb17651f093 sending to next pipeline
2026-03-30 11:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26977dfa-fcd7-5cad-8cce-6bb17651f093, identifier: EC96968
2026-03-30 11:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26977dfa-fcd7-5cad-8cce-6bb17651f093 with identifier: EC96968
2026-03-30 11:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26977dfa-fcd7-5cad-8cce-6bb17651f093 with identifier: EC96968
2026-03-30 11:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26977dfa-fcd7-5cad-8cce-6bb17651f093 with identifier: EC96968 to the API
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_9ad1a7ef67f8737194c323858a811f74.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:25:11Z',
 'fuel_type': 'petrol',
 'id': '26977dfa-fcd7-5cad-8cce-6bb17651f093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC96968',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 16962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_9ad1a7ef67f8737194c323858a811f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4419e822db880ac3c38980d97c8a8682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_fe90bfa46548dd3fe05ab6d9cde74e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_6aeedafcf7c8f61c63ff5a423c061633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_145ed244d0147419969aa01ecd9c6082.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_5aa6e2cd3614124c39b124250afd881f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_bfe50b56e372fd156de8219753da5709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_4fd7c8be033f0b2cc58e602b6642a644.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_cd00e8479dd85acb7287ea2d8ffa46cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26977dfa-fcd7-5cad-8cce-6bb17651f093/26977dfa-fcd7-5cad-8cce-6bb17651f093_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/ab/efabcd5fd560bb6f261f969a3f9f4d52/pa/EC96968_b77cc78a3dce9e6ee83d019faf3fbf08.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2022}
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC96968%27 HTTP/1.1" 200 None
2026-03-30 11:34:48 [auto1.be] INFO: Saving data for EC96968: {'created_time': 1774870488.833494, 'last_price_update_time': 1774870488.833507, 'auction_closing_time': 1774970711.0}
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EC96968') HTTP/1.1" 204 0
2026-03-30 11:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_0a497b4c0643b87aef6f018a1cf18296.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9767090>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_0a497b4c0643b87aef6f018a1cf18296.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_0a497b4c0643b87aef6f018a1cf18296.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_885fe3186bd3900f27e61b5c8f6cc1f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_de5d4dff668ee13720c04fc6997416f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b2a50>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_885fe3186bd3900f27e61b5c8f6cc1f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_885fe3186bd3900f27e61b5c8f6cc1f7.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_dfb13143443843c32f9f3854f9a4c1a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b1790>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_de5d4dff668ee13720c04fc6997416f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_de5d4dff668ee13720c04fc6997416f9.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d88d0>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_dfb13143443843c32f9f3854f9a4c1a5.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_dfb13143443843c32f9f3854f9a4c1a5.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7df00998764201127811ad2cd95f066a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a7110>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_7df00998764201127811ad2cd95f066a.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7df00998764201127811ad2cd95f066a.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7974bc28757fb17d33c0d3afe97b6beb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea214710>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_7974bc28757fb17d33c0d3afe97b6beb.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7974bc28757fb17d33c0d3afe97b6beb.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9862a10>
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F1d%252F6b1d72679c93f20e10ccb1e635efc4bd%252Fpa%252FRF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg saved to cache
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18739eb8-442c-58a7-a292-35a2d8279bda
2026-03-30 11:34:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18739eb8-442c-58a7-a292-35a2d8279bda, skipping ID generation
2026-03-30 11:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18739eb8-442c-58a7-a292-35a2d8279bda with scrape type 1
2026-03-30 11:34:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18739eb8-442c-58a7-a292-35a2d8279bda sending to next pipeline
2026-03-30 11:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18739eb8-442c-58a7-a292-35a2d8279bda, identifier: RF68102
2026-03-30 11:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18739eb8-442c-58a7-a292-35a2d8279bda with identifier: RF68102
2026-03-30 11:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18739eb8-442c-58a7-a292-35a2d8279bda with identifier: RF68102
2026-03-30 11:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18739eb8-442c-58a7-a292-35a2d8279bda with identifier: RF68102 to the API
2026-03-30 11:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:29:48Z',
 'fuel_type': 'diesel',
 'id': '18739eb8-442c-58a7-a292-35a2d8279bda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF68102',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'BMW',
 'model': '3er',
 'odometer': 129078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_a9b355896bb98fd36f7ed73107d00d7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7974bc28757fb17d33c0d3afe97b6beb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_7df00998764201127811ad2cd95f066a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_dfb13143443843c32f9f3854f9a4c1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_de5d4dff668ee13720c04fc6997416f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_885fe3186bd3900f27e61b5c8f6cc1f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_0a497b4c0643b87aef6f018a1cf18296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_58390a8bbef0f0709a9f2caa4ee7f373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_6c09885ebcf3899e7a4c4b1532f006e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18739eb8-442c-58a7-a292-35a2d8279bda/18739eb8-442c-58a7-a292-35a2d8279bda_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/1d/6b1d72679c93f20e10ccb1e635efc4bd/pa/RF68102_33d0accc51b88b25cbcee66090dbc3ba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 11:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF68102%27 HTTP/1.1" 200 None
2026-03-30 11:34:50 [auto1.be] INFO: Saving data for RF68102: {'created_time': 1774870490.286496, 'last_price_update_time': 1774870490.286507, 'auction_closing_time': 1774970988.0}
2026-03-30 11:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF68102') HTTP/1.1" 204 0
2026-03-30 11:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG16192/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG99216> (referer: https://www.auto1.com/v1/car-details-view/XG99216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a708dc50-1bcb-5fdc-b7d4-68d578633051 with identifier: XG99216
2026-03-30 11:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a708dc50-1bcb-5fdc-b7d4-68d578633051 with scrape type 1
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_32111ebb0fba909e6654450ef4c9f449.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_32111ebb0fba909e6654450ef4c9f449.jpg not downloaded yet
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_c5f63c80f622fb875099760fb7b76344.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_c5f63c80f622fb875099760fb7b76344.jpg not downloaded yet
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_8c2011fe94f4cfd51fa6d015180c7df1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_8c2011fe94f4cfd51fa6d015180c7df1.jpg not downloaded yet
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_5d6f2c403e9cfc78612a492e1b089669.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_5d6f2c403e9cfc78612a492e1b089669.jpg not downloaded yet
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_6131708844323992516a5c51c10cf6e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_6131708844323992516a5c51c10cf6e4.jpg not downloaded yet
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_7371c0e1ecf1873ba6a5763bd567cace.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_7371c0e1ecf1873ba6a5763bd567cace.jpg not downloaded yet
2026-03-30 11:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD88636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_7371c0e1ecf1873ba6a5763bd567cace.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9819ed0>
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_7371c0e1ecf1873ba6a5763bd567cace.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_7371c0e1ecf1873ba6a5763bd567cace.jpg saved to cache
2026-03-30 11:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_6131708844323992516a5c51c10cf6e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9786b50>
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:34:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_6131708844323992516a5c51c10cf6e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_6131708844323992516a5c51c10cf6e4.jpg saved to cache
2026-03-30 11:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:35:07 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 22 pages/min), scraped 61 items (at 15 items/min)
2026-03-30 11:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ81291> (referer: https://www.auto1.com/v1/car-details-view/GZ81291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 with identifier: GZ81291
2026-03-30 11:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 with scrape type 1
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_54565380497f3d433570a1a2f30db795.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_54565380497f3d433570a1a2f30db795.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_dae6e29b13215f872d05e26efa313f1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_dae6e29b13215f872d05e26efa313f1f.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_9cea473e2a21a2f9afc9adf28eda8b74.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_9cea473e2a21a2f9afc9adf28eda8b74.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_568647812572ba0cce0c6ef76b345ce1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_568647812572ba0cce0c6ef76b345ce1.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_369e914d21c712f17f8ae88097d96b48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_369e914d21c712f17f8ae88097d96b48.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_2f1ec998851105e6c62f286ef6ec640d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_2f1ec998851105e6c62f286ef6ec640d.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_ec22e1b737290a1d548ef4b0779b8f72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_ec22e1b737290a1d548ef4b0779b8f72.jpg not downloaded yet
2026-03-30 11:35:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_5d6f2c403e9cfc78612a492e1b089669.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_08a12a900d947dd951e755df1eb7cb70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_08a12a900d947dd951e755df1eb7cb70.jpg not downloaded yet
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_fc125054ecc97ce95cac60780bf66d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_fc125054ecc97ce95cac60780bf66d90.jpg not downloaded yet
2026-03-30 11:35:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b1cd0>
2026-03-30 11:35:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_5d6f2c403e9cfc78612a492e1b089669.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_5d6f2c403e9cfc78612a492e1b089669.jpg saved to cache
2026-03-30 11:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_ec22e1b737290a1d548ef4b0779b8f72.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9814910>
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_ec22e1b737290a1d548ef4b0779b8f72.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_ec22e1b737290a1d548ef4b0779b8f72.jpg saved to cache
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_fc125054ecc97ce95cac60780bf66d90.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f7cd0>
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_fc125054ecc97ce95cac60780bf66d90.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_fc125054ecc97ce95cac60780bf66d90.jpg saved to cache
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_08a12a900d947dd951e755df1eb7cb70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e986b150>
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_08a12a900d947dd951e755df1eb7cb70.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_08a12a900d947dd951e755df1eb7cb70.jpg saved to cache
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_2f1ec998851105e6c62f286ef6ec640d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9743210>
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_2f1ec998851105e6c62f286ef6ec640d.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_2f1ec998851105e6c62f286ef6ec640d.jpg saved to cache
2026-03-30 11:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_369e914d21c712f17f8ae88097d96b48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea133650>
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_369e914d21c712f17f8ae88097d96b48.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_369e914d21c712f17f8ae88097d96b48.jpg saved to cache
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_568647812572ba0cce0c6ef76b345ce1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0da190>
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_568647812572ba0cce0c6ef76b345ce1.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_568647812572ba0cce0c6ef76b345ce1.jpg saved to cache
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_9cea473e2a21a2f9afc9adf28eda8b74.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea205690>
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_9cea473e2a21a2f9afc9adf28eda8b74.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_9cea473e2a21a2f9afc9adf28eda8b74.jpg saved to cache
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB14047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_dae6e29b13215f872d05e26efa313f1f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_54565380497f3d433570a1a2f30db795.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97eb210>
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_dae6e29b13215f872d05e26efa313f1f.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_dae6e29b13215f872d05e26efa313f1f.jpg saved to cache
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97417d0>
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_54565380497f3d433570a1a2f30db795.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_54565380497f3d433570a1a2f30db795.jpg saved to cache
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_8c2011fe94f4cfd51fa6d015180c7df1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b3fd0>
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_8c2011fe94f4cfd51fa6d015180c7df1.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_8c2011fe94f4cfd51fa6d015180c7df1.jpg saved to cache
2026-03-30 11:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981ab50>
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F19%252F1a1919cacdae1821e017c8051387870b%252Fpa%252FGZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg saved to cache
2026-03-30 11:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683
2026-03-30 11:35:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fbd208f-fd7c-5fa2-b724-97ea6eb52683, skipping ID generation
2026-03-30 11:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 with scrape type 1
2026-03-30 11:35:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 sending to next pipeline
2026-03-30 11:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9fbd208f-fd7c-5fa2-b724-97ea6eb52683, identifier: GZ81291
2026-03-30 11:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 with identifier: GZ81291
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 11:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 with identifier: GZ81291
2026-03-30 11:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9fbd208f-fd7c-5fa2-b724-97ea6eb52683 with identifier: GZ81291 to the API
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 408,
 'expiration_date': '2026-03-31T15:59:01Z',
 'fuel_type': 'electro',
 'id': '9fbd208f-fd7c-5fa2-b724-97ea6eb52683',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ81291',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Polestar',
 'model': '2',
 'odometer': 71936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_54565380497f3d433570a1a2f30db795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_41bd47cd1a061ec1398c3a1c765c0514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_dae6e29b13215f872d05e26efa313f1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_9cea473e2a21a2f9afc9adf28eda8b74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_568647812572ba0cce0c6ef76b345ce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_369e914d21c712f17f8ae88097d96b48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_2f1ec998851105e6c62f286ef6ec640d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_ec22e1b737290a1d548ef4b0779b8f72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_08a12a900d947dd951e755df1eb7cb70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fbd208f-fd7c-5fa2-b724-97ea6eb52683/9fbd208f-fd7c-5fa2-b724-97ea6eb52683_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/19/1a1919cacdae1821e017c8051387870b/pa/GZ81291_fc125054ecc97ce95cac60780bf66d90.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Polestar 2 Long Range Dual',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ81291%27 HTTP/1.1" 200 None
2026-03-30 11:35:10 [auto1.be] INFO: Saving data for GZ81291: {'created_time': 1774870510.8735, 'last_price_update_time': 1774870510.873512, 'auction_closing_time': 1774972741.0}
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GZ81291') HTTP/1.1" 204 0
2026-03-30 11:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_c5f63c80f622fb875099760fb7b76344.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_32111ebb0fba909e6654450ef4c9f449.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97ba610>
2026-03-30 11:35:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_c5f63c80f622fb875099760fb7b76344.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_c5f63c80f622fb875099760fb7b76344.jpg saved to cache
2026-03-30 11:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:35:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e8610>
2026-03-30 11:35:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F4a%252Fe54a4214306487a02f1816275fdb96db%252Fpa%252FXG99216_32111ebb0fba909e6654450ef4c9f449.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_32111ebb0fba909e6654450ef4c9f449.jpg saved to cache
2026-03-30 11:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a708dc50-1bcb-5fdc-b7d4-68d578633051
2026-03-30 11:35:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a708dc50-1bcb-5fdc-b7d4-68d578633051, skipping ID generation
2026-03-30 11:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a708dc50-1bcb-5fdc-b7d4-68d578633051 with scrape type 1
2026-03-30 11:35:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a708dc50-1bcb-5fdc-b7d4-68d578633051 sending to next pipeline
2026-03-30 11:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a708dc50-1bcb-5fdc-b7d4-68d578633051, identifier: XG99216
2026-03-30 11:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a708dc50-1bcb-5fdc-b7d4-68d578633051 with identifier: XG99216
2026-03-30 11:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a708dc50-1bcb-5fdc-b7d4-68d578633051 with identifier: XG99216
2026-03-30 11:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a708dc50-1bcb-5fdc-b7d4-68d578633051 with identifier: XG99216 to the API
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_32111ebb0fba909e6654450ef4c9f449.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:30:11Z',
 'fuel_type': 'diesel',
 'id': 'a708dc50-1bcb-5fdc-b7d4-68d578633051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG99216',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 170624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_32111ebb0fba909e6654450ef4c9f449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_c5f63c80f622fb875099760fb7b76344.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_8c2011fe94f4cfd51fa6d015180c7df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_5d6f2c403e9cfc78612a492e1b089669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_6131708844323992516a5c51c10cf6e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a708dc50-1bcb-5fdc-b7d4-68d578633051/a708dc50-1bcb-5fdc-b7d4-68d578633051_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/4a/e54a4214306487a02f1816275fdb96db/pa/XG99216_7371c0e1ecf1873ba6a5763bd567cace.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Feline',
 'transmission': 'manual',
 'trim': 'Feline',
 'year': 2009}
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG99216%27 HTTP/1.1" 200 None
2026-03-30 11:35:11 [auto1.be] INFO: Saving data for XG99216: {'created_time': 1774870511.572158, 'last_price_update_time': 1774870511.57217, 'auction_closing_time': 1774971011.0}
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG99216') HTTP/1.1" 204 0
2026-03-30 11:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ79975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC26053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX96878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF63760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL07938> (referer: https://www.auto1.com/v1/car-details-view/UL07938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38 with identifier: UL07938
2026-03-30 11:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38 with scrape type 1
2026-03-30 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38
2026-03-30 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_b6080b4b7d35920c72666b2feec97822.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_b6080b4b7d35920c72666b2feec97822.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_3bb7981c5b7bc40fb49c95a9c8c6fce6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_3bb7981c5b7bc40fb49c95a9c8c6fce6.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_d136ef15d1b168adc3c83812b68b22b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_d136ef15d1b168adc3c83812b68b22b9.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_6a18810b88ab6c144d99420464192fd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_6a18810b88ab6c144d99420464192fd7.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_0911864e7e638d3a2e9b5ea7f255df16.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_0911864e7e638d3a2e9b5ea7f255df16.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_8fdd99f5d858eb4387e16d2ba8d2d2e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_8fdd99f5d858eb4387e16d2ba8d2d2e0.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_635d45e293ee9cc25f81cb5e18b97318.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_635d45e293ee9cc25f81cb5e18b97318.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_991cde8bb25d8cfe7203456a9ac5fb13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_991cde8bb25d8cfe7203456a9ac5fb13.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_2aad4682ca3f2335a1a15325b05b86f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_2aad4682ca3f2335a1a15325b05b86f4.jpg already downloaded
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F58%252F3d58fc532c3493aa4cbc4f136c36da7a%252Fpa%252FUL07938_301d999d5af0e54f55fabd2eec63ffc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_301d999d5af0e54f55fabd2eec63ffc3.jpg already downloaded
2026-03-30 11:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38, identifier: UL07938
2026-03-30 11:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38 with identifier: UL07938
2026-03-30 11:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38 with identifier: UL07938
2026-03-30 11:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6f8489c9-11ce-5eb3-986e-8cedcbf3ea38 with identifier: UL07938 to the API
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL07938>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:01:44Z',
 'fuel_type': 'petrol',
 'id': '6f8489c9-11ce-5eb3-986e-8cedcbf3ea38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL07938',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 112156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photo_urls': ['https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_b6080b4b7d35920c72666b2feec97822.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_3bb7981c5b7bc40fb49c95a9c8c6fce6.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_d136ef15d1b168adc3c83812b68b22b9.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_6a18810b88ab6c144d99420464192fd7.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_0911864e7e638d3a2e9b5ea7f255df16.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_8fdd99f5d858eb4387e16d2ba8d2d2e0.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_635d45e293ee9cc25f81cb5e18b97318.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_991cde8bb25d8cfe7203456a9ac5fb13.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_2aad4682ca3f2335a1a15325b05b86f4.jpg',
                'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_301d999d5af0e54f55fabd2eec63ffc3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_b6080b4b7d35920c72666b2feec97822.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_3bb7981c5b7bc40fb49c95a9c8c6fce6.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_d136ef15d1b168adc3c83812b68b22b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_6a18810b88ab6c144d99420464192fd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_0911864e7e638d3a2e9b5ea7f255df16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_8fdd99f5d858eb4387e16d2ba8d2d2e0.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_635d45e293ee9cc25f81cb5e18b97318.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_991cde8bb25d8cfe7203456a9ac5fb13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_2aad4682ca3f2335a1a15325b05b86f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f8489c9-11ce-5eb3-986e-8cedcbf3ea38/6f8489c9-11ce-5eb3-986e-8cedcbf3ea38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/58/3d58fc532c3493aa4cbc4f136c36da7a/pa/UL07938_301d999d5af0e54f55fabd2eec63ffc3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2013}
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL07938%27 HTTP/1.1" 200 None
2026-03-30 11:35:30 [auto1.be] INFO: Saving data for UL07938: {'created_time': 1774870530.618383, 'last_price_update_time': 1774870530.618393, 'auction_closing_time': 1774969304.0}
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL07938') HTTP/1.1" 204 0
2026-03-30 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH66353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU93857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA52655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB14047> (referer: https://www.auto1.com/v1/car-details-view/EB14047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d03bf49-e305-563a-8660-d48b0c7a9791 with identifier: EB14047
2026-03-30 11:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d03bf49-e305-563a-8660-d48b0c7a9791 with scrape type 1
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_2d6c07b2aa8ceaab2e44d5100f784475.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_2d6c07b2aa8ceaab2e44d5100f784475.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_08e2d682b87a012e680abec93d4ff4ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08e2d682b87a012e680abec93d4ff4ec.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_335098bdd85d5a805864b6b0dd5b7560.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_335098bdd85d5a805864b6b0dd5b7560.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_d735c2ca02e03d49166c0813e8233a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_d735c2ca02e03d49166c0813e8233a0e.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_da2ec197e6958a10b999718109919a85.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_da2ec197e6958a10b999718109919a85.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_a8718cd01639d581b8e57b50c3271e9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_a8718cd01639d581b8e57b50c3271e9b.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_9638387d4b8b89dedad657acbeb414cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_9638387d4b8b89dedad657acbeb414cf.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_08a23c3bb95a28aa9aedb72745d37073.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08a23c3bb95a28aa9aedb72745d37073.jpg not downloaded yet
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_1546a98e00a6f5be74b8100aae60d735.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_1546a98e00a6f5be74b8100aae60d735.jpg not downloaded yet
2026-03-30 11:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS95639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_1546a98e00a6f5be74b8100aae60d735.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12ecd0>
2026-03-30 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_1546a98e00a6f5be74b8100aae60d735.jpg') HTTP/1.1" 204 0
2026-03-30 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_1546a98e00a6f5be74b8100aae60d735.jpg saved to cache
2026-03-30 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:07 [scrapy.extensions.logstats] INFO: Crawled 101 pages (at 12 pages/min), scraped 64 items (at 3 items/min)
2026-03-30 11:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ79975> (referer: https://www.auto1.com/v1/car-details-view/GZ79975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 with identifier: GZ79975
2026-03-30 11:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 with scrape type 1
2026-03-30 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_1019affcd28f8420173949c9f494104c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_1019affcd28f8420173949c9f494104c.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_ef916a098c0de6d5359725ce4f195126.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_ef916a098c0de6d5359725ce4f195126.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_d2ac6615cdc054aefcef977653346cfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_d2ac6615cdc054aefcef977653346cfa.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_43547f574f8b580d0ded63503f4def07.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_43547f574f8b580d0ded63503f4def07.jpg not downloaded yet
2026-03-30 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08a23c3bb95a28aa9aedb72745d37073.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_749053655b6cf03ce0df3972a32cb78f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_749053655b6cf03ce0df3972a32cb78f.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_cd77e1fb792be6ef9392939c0574914a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_cd77e1fb792be6ef9392939c0574914a.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_917399ceb8e5ad5415367f37f60ca383.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_917399ceb8e5ad5415367f37f60ca383.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_6a7e815b1e8654ed27a92110939388d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_6a7e815b1e8654ed27a92110939388d1.jpg not downloaded yet
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_5f42445d08ed2ef4b8ad05aee839ed12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5f42445d08ed2ef4b8ad05aee839ed12.jpg not downloaded yet
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea217450>
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_08a23c3bb95a28aa9aedb72745d37073.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08a23c3bb95a28aa9aedb72745d37073.jpg saved to cache
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_43547f574f8b580d0ded63503f4def07.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fea50>
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_43547f574f8b580d0ded63503f4def07.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_43547f574f8b580d0ded63503f4def07.jpg saved to cache
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5f42445d08ed2ef4b8ad05aee839ed12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9741610>
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_5f42445d08ed2ef4b8ad05aee839ed12.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5f42445d08ed2ef4b8ad05aee839ed12.jpg saved to cache
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_6a7e815b1e8654ed27a92110939388d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a5310>
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_6a7e815b1e8654ed27a92110939388d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_6a7e815b1e8654ed27a92110939388d1.jpg saved to cache
2026-03-30 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC26053> (referer: https://www.auto1.com/v1/car-details-view/WC26053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_917399ceb8e5ad5415367f37f60ca383.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 021d90c2-5f0e-572c-80c8-222926fd585e with identifier: WC26053
2026-03-30 11:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 021d90c2-5f0e-572c-80c8-222926fd585e with scrape type 1
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_caa7d72b165c4edb96e93dde5d4d8530.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_caa7d72b165c4edb96e93dde5d4d8530.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_208b4a7ff96ae132c132722b3b260b19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_208b4a7ff96ae132c132722b3b260b19.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_50e1730074e1cde358ed30d5856827d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_50e1730074e1cde358ed30d5856827d1.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_358042d8cd5124b483d4624b1b88fda2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_358042d8cd5124b483d4624b1b88fda2.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_1aaa5750ad8dc1249596d634bdea7c39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_1aaa5750ad8dc1249596d634bdea7c39.jpg not downloaded yet
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cca10>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_917399ceb8e5ad5415367f37f60ca383.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_917399ceb8e5ad5415367f37f60ca383.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_327d7544f1f28d790ea0e4bb71561f11.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_327d7544f1f28d790ea0e4bb71561f11.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_771fc4701e319bfd396b8c5b3f5955b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_771fc4701e319bfd396b8c5b3f5955b8.jpg not downloaded yet
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_749053655b6cf03ce0df3972a32cb78f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_cd77e1fb792be6ef9392939c0574914a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_51084b18302303442e8b601874ef0b6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_51084b18302303442e8b601874ef0b6a.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_2b90392606602b998d49198b07e445fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_2b90392606602b998d49198b07e445fd.jpg not downloaded yet
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_37e93e6e7e7efb04b4259dfa9790e904.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_37e93e6e7e7efb04b4259dfa9790e904.jpg not downloaded yet
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_327d7544f1f28d790ea0e4bb71561f11.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea10c750>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_749053655b6cf03ce0df3972a32cb78f.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_749053655b6cf03ce0df3972a32cb78f.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96fc7d0>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_cd77e1fb792be6ef9392939c0574914a.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_cd77e1fb792be6ef9392939c0574914a.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e8550>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_327d7544f1f28d790ea0e4bb71561f11.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_327d7544f1f28d790ea0e4bb71561f11.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_771fc4701e319bfd396b8c5b3f5955b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_37e93e6e7e7efb04b4259dfa9790e904.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_51084b18302303442e8b601874ef0b6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96dbe90>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_771fc4701e319bfd396b8c5b3f5955b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_771fc4701e319bfd396b8c5b3f5955b8.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d95d0>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_37e93e6e7e7efb04b4259dfa9790e904.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_37e93e6e7e7efb04b4259dfa9790e904.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_1aaa5750ad8dc1249596d634bdea7c39.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cf810>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_51084b18302303442e8b601874ef0b6a.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_51084b18302303442e8b601874ef0b6a.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_2b90392606602b998d49198b07e445fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea21a910>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_1aaa5750ad8dc1249596d634bdea7c39.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_1aaa5750ad8dc1249596d634bdea7c39.jpg saved to cache
2026-03-30 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96fde10>
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_2b90392606602b998d49198b07e445fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_2b90392606602b998d49198b07e445fd.jpg saved to cache
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_358042d8cd5124b483d4624b1b88fda2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_50e1730074e1cde358ed30d5856827d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9767550>
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_358042d8cd5124b483d4624b1b88fda2.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_358042d8cd5124b483d4624b1b88fda2.jpg saved to cache
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_caa7d72b165c4edb96e93dde5d4d8530.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1034d0>
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_50e1730074e1cde358ed30d5856827d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_50e1730074e1cde358ed30d5856827d1.jpg saved to cache
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_208b4a7ff96ae132c132722b3b260b19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX96878> (referer: https://www.auto1.com/v1/car-details-view/FX96878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c3850>
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_caa7d72b165c4edb96e93dde5d4d8530.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_caa7d72b165c4edb96e93dde5d4d8530.jpg saved to cache
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_ef916a098c0de6d5359725ce4f195126.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a6150>
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252Fe3%252F03e381730f4e4e2c4b33b9c77ce37087%252Fpa%252FWC26053_208b4a7ff96ae132c132722b3b260b19.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_208b4a7ff96ae132c132722b3b260b19.jpg saved to cache
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 021d90c2-5f0e-572c-80c8-222926fd585e
2026-03-30 11:36:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 021d90c2-5f0e-572c-80c8-222926fd585e, skipping ID generation
2026-03-30 11:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 021d90c2-5f0e-572c-80c8-222926fd585e with scrape type 1
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 021d90c2-5f0e-572c-80c8-222926fd585e sending to next pipeline
2026-03-30 11:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 021d90c2-5f0e-572c-80c8-222926fd585e, identifier: WC26053
2026-03-30 11:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 021d90c2-5f0e-572c-80c8-222926fd585e with identifier: WC26053
2026-03-30 11:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 021d90c2-5f0e-572c-80c8-222926fd585e with identifier: WC26053
2026-03-30 11:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 021d90c2-5f0e-572c-80c8-222926fd585e with identifier: WC26053 to the API
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_208b4a7ff96ae132c132722b3b260b19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:01:58Z',
 'fuel_type': 'diesel',
 'id': '021d90c2-5f0e-572c-80c8-222926fd585e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC26053',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 246554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_caa7d72b165c4edb96e93dde5d4d8530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_208b4a7ff96ae132c132722b3b260b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_50e1730074e1cde358ed30d5856827d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_358042d8cd5124b483d4624b1b88fda2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_1aaa5750ad8dc1249596d634bdea7c39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_327d7544f1f28d790ea0e4bb71561f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_771fc4701e319bfd396b8c5b3f5955b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_51084b18302303442e8b601874ef0b6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_2b90392606602b998d49198b07e445fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_021d90c2-5f0e-572c-80c8-222926fd585e/021d90c2-5f0e-572c-80c8-222926fd585e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/e3/03e381730f4e4e2c4b33b9c77ce37087/pa/WC26053_37e93e6e7e7efb04b4259dfa9790e904.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2013}
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC26053%27 HTTP/1.1" 200 None
2026-03-30 11:36:15 [auto1.be] INFO: Saving data for WC26053: {'created_time': 1774870575.930402, 'last_price_update_time': 1774870575.930413, 'auction_closing_time': 1774969318.0}
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC26053') HTTP/1.1" 204 0
2026-03-30 11:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e1485f-1757-5072-8c75-80467c50fdeb with identifier: FX96878
2026-03-30 11:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e1485f-1757-5072-8c75-80467c50fdeb with scrape type 1
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_2d0f09e7c1fbcf8f45a55694e2d4d9e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_2d0f09e7c1fbcf8f45a55694e2d4d9e4.jpg not downloaded yet
2026-03-30 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_d2ac6615cdc054aefcef977653346cfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg not downloaded yet
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97bb0d0>
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_ef916a098c0de6d5359725ce4f195126.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_ef916a098c0de6d5359725ce4f195126.jpg saved to cache
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_54e62b215f242cb0e92bb8a5fdc3c946.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_54e62b215f242cb0e92bb8a5fdc3c946.jpg not downloaded yet
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_8ea5991095cdba4b5ef01a43a11087dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_8ea5991095cdba4b5ef01a43a11087dd.jpg not downloaded yet
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_f263dcf8bbddf70b256c16ad2599687b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f263dcf8bbddf70b256c16ad2599687b.jpg not downloaded yet
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_b6e3309af04ff4fba5b215453c1fdb6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_b6e3309af04ff4fba5b215453c1fdb6f.jpg not downloaded yet
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9748d10>
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_d2ac6615cdc054aefcef977653346cfa.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_d2ac6615cdc054aefcef977653346cfa.jpg saved to cache
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_2d0f09e7c1fbcf8f45a55694e2d4d9e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_ff321ab04c56d4aa135582526639dd3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_ff321ab04c56d4aa135582526639dd3d.jpg not downloaded yet
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_f92c1f3457638e05698fdab1dd78d985.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f92c1f3457638e05698fdab1dd78d985.jpg not downloaded yet
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_1c4f587ca80d3c1f80fb8d8b5aa6faa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_1c4f587ca80d3c1f80fb8d8b5aa6faa6.jpg not downloaded yet
2026-03-30 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_1019affcd28f8420173949c9f494104c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_a02686b2a9037f1f064ed30d60e5530e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_a02686b2a9037f1f064ed30d60e5530e.jpg not downloaded yet
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975e8d0>
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_2d0f09e7c1fbcf8f45a55694e2d4d9e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_2d0f09e7c1fbcf8f45a55694e2d4d9e4.jpg saved to cache
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9832450>
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_1019affcd28f8420173949c9f494104c.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_1019affcd28f8420173949c9f494104c.jpg saved to cache
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:36:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:36:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:36:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a4790>
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F4e%252Fe14e2a57b4e58962f7256d9207ce0138%252Fpa%252FGZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg saved to cache
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1
2026-03-30 11:36:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1, skipping ID generation
2026-03-30 11:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 with scrape type 1
2026-03-30 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 sending to next pipeline
2026-03-30 11:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1, identifier: GZ79975
2026-03-30 11:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 with identifier: GZ79975
2026-03-30 11:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 with identifier: GZ79975
2026-03-30 11:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1 with identifier: GZ79975 to the API
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:58:24Z',
 'fuel_type': 'petrol',
 'id': '44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ79975',
 'listing': 'auction',
 'location': 'BE',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 219268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4040959,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5c08d5cd4310849feb3c931a22dbc53d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_1019affcd28f8420173949c9f494104c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_ef916a098c0de6d5359725ce4f195126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_d2ac6615cdc054aefcef977653346cfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_43547f574f8b580d0ded63503f4def07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_749053655b6cf03ce0df3972a32cb78f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_cd77e1fb792be6ef9392939c0574914a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_917399ceb8e5ad5415367f37f60ca383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_6a7e815b1e8654ed27a92110939388d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1/44d9a32c-cc0c-591e-bfd1-27f3ad9b1ec1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/4e/e14e2a57b4e58962f7256d9207ce0138/pa/GZ79975_5f42445d08ed2ef4b8ad05aee839ed12.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ79975%27 HTTP/1.1" 200 None
2026-03-30 11:36:16 [auto1.be] INFO: Saving data for GZ79975: {'created_time': 1774870576.9762, 'last_price_update_time': 1774870576.976211, 'auction_closing_time': 1774972704.0}
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GZ79975') HTTP/1.1" 204 0
2026-03-30 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_b6e3309af04ff4fba5b215453c1fdb6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_1c4f587ca80d3c1f80fb8d8b5aa6faa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_a02686b2a9037f1f064ed30d60e5530e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea146e10>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_b6e3309af04ff4fba5b215453c1fdb6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_b6e3309af04ff4fba5b215453c1fdb6f.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f40d0>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_1c4f587ca80d3c1f80fb8d8b5aa6faa6.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_1c4f587ca80d3c1f80fb8d8b5aa6faa6.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea132e50>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_a02686b2a9037f1f064ed30d60e5530e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_a02686b2a9037f1f064ed30d60e5530e.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f92c1f3457638e05698fdab1dd78d985.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_ff321ab04c56d4aa135582526639dd3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9767e90>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_f92c1f3457638e05698fdab1dd78d985.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f92c1f3457638e05698fdab1dd78d985.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_54e62b215f242cb0e92bb8a5fdc3c946.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b9f50>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_ff321ab04c56d4aa135582526639dd3d.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_ff321ab04c56d4aa135582526639dd3d.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_8ea5991095cdba4b5ef01a43a11087dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7f9c82cd0>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_54e62b215f242cb0e92bb8a5fdc3c946.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_54e62b215f242cb0e92bb8a5fdc3c946.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f263dcf8bbddf70b256c16ad2599687b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a4950>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_8ea5991095cdba4b5ef01a43a11087dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_8ea5991095cdba4b5ef01a43a11087dd.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fc890>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_f263dcf8bbddf70b256c16ad2599687b.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f263dcf8bbddf70b256c16ad2599687b.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_9638387d4b8b89dedad657acbeb414cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_a8718cd01639d581b8e57b50c3271e9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a4850>
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F05%252F910540d6813b693be28a63e81155de22%252Fpa%252FFX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg saved to cache
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88e1485f-1757-5072-8c75-80467c50fdeb
2026-03-30 11:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88e1485f-1757-5072-8c75-80467c50fdeb, skipping ID generation
2026-03-30 11:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e1485f-1757-5072-8c75-80467c50fdeb with scrape type 1
2026-03-30 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88e1485f-1757-5072-8c75-80467c50fdeb sending to next pipeline
2026-03-30 11:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 88e1485f-1757-5072-8c75-80467c50fdeb, identifier: FX96878
2026-03-30 11:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 88e1485f-1757-5072-8c75-80467c50fdeb with identifier: FX96878
2026-03-30 11:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 88e1485f-1757-5072-8c75-80467c50fdeb with identifier: FX96878
2026-03-30 11:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 88e1485f-1757-5072-8c75-80467c50fdeb with identifier: FX96878 to the API
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:06:16Z',
 'fuel_type': 'diesel',
 'id': '88e1485f-1757-5072-8c75-80467c50fdeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX96878',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Ssangyong',
 'model': 'Rexton',
 'odometer': 62292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_2d0f09e7c1fbcf8f45a55694e2d4d9e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_59a8227d5a42ae57e1b6260bd47a0453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_54e62b215f242cb0e92bb8a5fdc3c946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_8ea5991095cdba4b5ef01a43a11087dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2897690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f263dcf8bbddf70b256c16ad2599687b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_b6e3309af04ff4fba5b215453c1fdb6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_ff321ab04c56d4aa135582526639dd3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_f92c1f3457638e05698fdab1dd78d985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_1c4f587ca80d3c1f80fb8d8b5aa6faa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88e1485f-1757-5072-8c75-80467c50fdeb/88e1485f-1757-5072-8c75-80467c50fdeb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325967,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img91/05/910540d6813b693be28a63e81155de22/pa/FX96878_a02686b2a9037f1f064ed30d60e5530e.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ssangyong Rexton 2.0 TD Quartz 4x4',
 'transmission': 'automatic',
 'trim': 'Quartz 4x4',
 'year': 2015}
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FX96878%27 HTTP/1.1" 200 None
2026-03-30 11:36:18 [auto1.be] INFO: Saving data for FX96878: {'created_time': 1774870578.366378, 'last_price_update_time': 1774870578.36639, 'auction_closing_time': 1774969576.0}
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FX96878') HTTP/1.1" 204 0
2026-03-30 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_da2ec197e6958a10b999718109919a85.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_335098bdd85d5a805864b6b0dd5b7560.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_d735c2ca02e03d49166c0813e8233a0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98746d0>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_9638387d4b8b89dedad657acbeb414cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_9638387d4b8b89dedad657acbeb414cf.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96cfbd0>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_a8718cd01639d581b8e57b50c3271e9b.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_a8718cd01639d581b8e57b50c3271e9b.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d9d50>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_da2ec197e6958a10b999718109919a85.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_da2ec197e6958a10b999718109919a85.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_2d6c07b2aa8ceaab2e44d5100f784475.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98158d0>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_335098bdd85d5a805864b6b0dd5b7560.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_335098bdd85d5a805864b6b0dd5b7560.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea10fcd0>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_d735c2ca02e03d49166c0813e8233a0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_d735c2ca02e03d49166c0813e8233a0e.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08e2d682b87a012e680abec93d4ff4ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9845f90>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_2d6c07b2aa8ceaab2e44d5100f784475.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_2d6c07b2aa8ceaab2e44d5100f784475.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2df490>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_08e2d682b87a012e680abec93d4ff4ec.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08e2d682b87a012e680abec93d4ff4ec.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea130e90>
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F40%252F5940a6685af44ed8df1742fee21edf75%252Fpa%252FEB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg saved to cache
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d03bf49-e305-563a-8660-d48b0c7a9791
2026-03-30 11:36:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d03bf49-e305-563a-8660-d48b0c7a9791, skipping ID generation
2026-03-30 11:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d03bf49-e305-563a-8660-d48b0c7a9791 with scrape type 1
2026-03-30 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d03bf49-e305-563a-8660-d48b0c7a9791 sending to next pipeline
2026-03-30 11:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1d03bf49-e305-563a-8660-d48b0c7a9791, identifier: EB14047
2026-03-30 11:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1d03bf49-e305-563a-8660-d48b0c7a9791 with identifier: EB14047
2026-03-30 11:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1d03bf49-e305-563a-8660-d48b0c7a9791 with identifier: EB14047
2026-03-30 11:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1d03bf49-e305-563a-8660-d48b0c7a9791 with identifier: EB14047 to the API
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:44:12Z',
 'fuel_type': 'diesel',
 'id': '1d03bf49-e305-563a-8660-d48b0c7a9791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB14047',
 'listing': 'auction',
 'location': 'BE',
 'make': 'BMW',
 'model': '1er',
 'odometer': 76351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_2d6c07b2aa8ceaab2e44d5100f784475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08e2d682b87a012e680abec93d4ff4ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_823e4f09ecbd0b6cff38009cbdf309ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_335098bdd85d5a805864b6b0dd5b7560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_d735c2ca02e03d49166c0813e8233a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_da2ec197e6958a10b999718109919a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_a8718cd01639d581b8e57b50c3271e9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_9638387d4b8b89dedad657acbeb414cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_08a23c3bb95a28aa9aedb72745d37073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d03bf49-e305-563a-8660-d48b0c7a9791/1d03bf49-e305-563a-8660-d48b0c7a9791_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/40/5940a6685af44ed8df1742fee21edf75/pa/EB14047_1546a98e00a6f5be74b8100aae60d735.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB14047%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [auto1.be] INFO: Saving data for EB14047: {'created_time': 1774870579.328648, 'last_price_update_time': 1774870579.328661, 'auction_closing_time': 1774971852.0}
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB14047') HTTP/1.1" 204 0
2026-03-30 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF63760> (referer: https://www.auto1.com/v1/car-details-view/JF63760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 744da18a-5210-5754-afe2-0642eb5dd641 with identifier: JF63760
2026-03-30 11:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744da18a-5210-5754-afe2-0642eb5dd641 with scrape type 1
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_bb34dfc8538b231e8ad1871f8210b734.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_bb34dfc8538b231e8ad1871f8210b734.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_96bfa8252af0399e345aa8b9bbb3b821.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_96bfa8252af0399e345aa8b9bbb3b821.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_b3dafe515660c4e47d9be38a6b106e08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_b3dafe515660c4e47d9be38a6b106e08.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_95b158c6ffb333b3a0acba9a773cdab4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_95b158c6ffb333b3a0acba9a773cdab4.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_aa3e2f97bebffeb9d3113598695b2f4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_aa3e2f97bebffeb9d3113598695b2f4b.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_939493f9cdb7a75eb6276820b24f3c44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_939493f9cdb7a75eb6276820b24f3c44.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_d864fbf1a94d7753d789f4be79b9fdee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_d864fbf1a94d7753d789f4be79b9fdee.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_a20a65366f8a4246a062db37ad106f73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_a20a65366f8a4246a062db37ad106f73.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_61e4fbbed08b6ce783d652e0fec3eec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_61e4fbbed08b6ce783d652e0fec3eec1.jpg not downloaded yet
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_9b171f3bcf5a97bf8be1a253e7097908.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_9b171f3bcf5a97bf8be1a253e7097908.jpg not downloaded yet
2026-03-30 11:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK55649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_9b171f3bcf5a97bf8be1a253e7097908.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_61e4fbbed08b6ce783d652e0fec3eec1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec063590>
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_9b171f3bcf5a97bf8be1a253e7097908.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_9b171f3bcf5a97bf8be1a253e7097908.jpg saved to cache
2026-03-30 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9765a10>
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_61e4fbbed08b6ce783d652e0fec3eec1.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_61e4fbbed08b6ce783d652e0fec3eec1.jpg saved to cache
2026-03-30 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH66353> (referer: https://www.auto1.com/v1/car-details-view/JH66353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f63812-413d-5119-9534-e05a088d2984 with identifier: JH66353
2026-03-30 11:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f63812-413d-5119-9534-e05a088d2984 with scrape type 1
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_229b145c3789789d33ede1c9b17eae04.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_229b145c3789789d33ede1c9b17eae04.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_8fb02f350075387300654e5e6eb4fd9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_8fb02f350075387300654e5e6eb4fd9e.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_dc5080268da6b0b2524b7a623b643464.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_dc5080268da6b0b2524b7a623b643464.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_4be0f757a6142f51b272a0d45d006d5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_4be0f757a6142f51b272a0d45d006d5e.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_ae0d438676fed20f6c6f0075eb90a479.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_ae0d438676fed20f6c6f0075eb90a479.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_2a7524c1f850701471e9a60b20d1ba13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_2a7524c1f850701471e9a60b20d1ba13.jpg not downloaded yet
2026-03-30 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_a20a65366f8a4246a062db37ad106f73.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_279178dc0585f402bdcbed77ee065534.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_279178dc0585f402bdcbed77ee065534.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_1f25bf559365449b6863958d054db8a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_1f25bf559365449b6863958d054db8a7.jpg not downloaded yet
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_77ad3f088d69c8cc1b30d497be7c038c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_77ad3f088d69c8cc1b30d497be7c038c.jpg not downloaded yet
2026-03-30 11:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981b850>
2026-03-30 11:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_a20a65366f8a4246a062db37ad106f73.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_a20a65366f8a4246a062db37ad106f73.jpg saved to cache
2026-03-30 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_2a7524c1f850701471e9a60b20d1ba13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975dd50>
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_2a7524c1f850701471e9a60b20d1ba13.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_2a7524c1f850701471e9a60b20d1ba13.jpg saved to cache
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_77ad3f088d69c8cc1b30d497be7c038c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9825190>
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_77ad3f088d69c8cc1b30d497be7c038c.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_77ad3f088d69c8cc1b30d497be7c038c.jpg saved to cache
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_1f25bf559365449b6863958d054db8a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fcd50>
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_1f25bf559365449b6863958d054db8a7.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_1f25bf559365449b6863958d054db8a7.jpg saved to cache
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC22356/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_279178dc0585f402bdcbed77ee065534.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9820150>
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_279178dc0585f402bdcbed77ee065534.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_279178dc0585f402bdcbed77ee065534.jpg saved to cache
2026-03-30 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_ae0d438676fed20f6c6f0075eb90a479.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.471(s), this was the 1st time calling it.
2026-03-30 11:36:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.062003603727612 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e6b10>
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_ae0d438676fed20f6c6f0075eb90a479.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_ae0d438676fed20f6c6f0075eb90a479.jpg saved to cache
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_4be0f757a6142f51b272a0d45d006d5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e986bc10>
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_4be0f757a6142f51b272a0d45d006d5e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_4be0f757a6142f51b272a0d45d006d5e.jpg saved to cache
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_dc5080268da6b0b2524b7a623b643464.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e6e90>
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_dc5080268da6b0b2524b7a623b643464.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_dc5080268da6b0b2524b7a623b643464.jpg saved to cache
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_8fb02f350075387300654e5e6eb4fd9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9877310>
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_8fb02f350075387300654e5e6eb4fd9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_8fb02f350075387300654e5e6eb4fd9e.jpg saved to cache
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_229b145c3789789d33ede1c9b17eae04.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e7950>
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_229b145c3789789d33ede1c9b17eae04.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_229b145c3789789d33ede1c9b17eae04.jpg saved to cache
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_d864fbf1a94d7753d789f4be79b9fdee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ae7d0>
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F5b%252F505b1cf1157cb022e217d8d135eff782%252Fpa%252FJH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg saved to cache
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36f63812-413d-5119-9534-e05a088d2984
2026-03-30 11:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36f63812-413d-5119-9534-e05a088d2984, skipping ID generation
2026-03-30 11:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f63812-413d-5119-9534-e05a088d2984 with scrape type 1
2026-03-30 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36f63812-413d-5119-9534-e05a088d2984 sending to next pipeline
2026-03-30 11:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36f63812-413d-5119-9534-e05a088d2984, identifier: JH66353
2026-03-30 11:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36f63812-413d-5119-9534-e05a088d2984 with identifier: JH66353
2026-03-30 11:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36f63812-413d-5119-9534-e05a088d2984 with identifier: JH66353
2026-03-30 11:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36f63812-413d-5119-9534-e05a088d2984 with identifier: JH66353 to the API
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:47:36Z',
 'fuel_type': 'petrol',
 'id': '36f63812-413d-5119-9534-e05a088d2984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH66353',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 152190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_c2ba21f075b8ef12dbefafd0d15ed90e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_229b145c3789789d33ede1c9b17eae04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_8fb02f350075387300654e5e6eb4fd9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_dc5080268da6b0b2524b7a623b643464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_4be0f757a6142f51b272a0d45d006d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_ae0d438676fed20f6c6f0075eb90a479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_2a7524c1f850701471e9a60b20d1ba13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_279178dc0585f402bdcbed77ee065534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_1f25bf559365449b6863958d054db8a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f63812-413d-5119-9534-e05a088d2984/36f63812-413d-5119-9534-e05a088d2984_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/5b/505b1cf1157cb022e217d8d135eff782/pa/JH66353_77ad3f088d69c8cc1b30d497be7c038c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-01-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C2 1.1 X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2005}
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH66353%27 HTTP/1.1" 200 None
2026-03-30 11:36:28 [auto1.be] INFO: Saving data for JH66353: {'created_time': 1774870588.546608, 'last_price_update_time': 1774870588.546618, 'auction_closing_time': 1774972056.0}
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JH66353') HTTP/1.1" 204 0
2026-03-30 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_939493f9cdb7a75eb6276820b24f3c44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981b950>
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_d864fbf1a94d7753d789f4be79b9fdee.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_d864fbf1a94d7753d789f4be79b9fdee.jpg saved to cache
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975c650>
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_939493f9cdb7a75eb6276820b24f3c44.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_939493f9cdb7a75eb6276820b24f3c44.jpg saved to cache
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_aa3e2f97bebffeb9d3113598695b2f4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_95b158c6ffb333b3a0acba9a773cdab4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97668d0>
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_aa3e2f97bebffeb9d3113598695b2f4b.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_aa3e2f97bebffeb9d3113598695b2f4b.jpg saved to cache
2026-03-30 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e43d0>
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_95b158c6ffb333b3a0acba9a773cdab4.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_95b158c6ffb333b3a0acba9a773cdab4.jpg saved to cache
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_b3dafe515660c4e47d9be38a6b106e08.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9765f90>
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_b3dafe515660c4e47d9be38a6b106e08.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_b3dafe515660c4e47d9be38a6b106e08.jpg saved to cache
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_96bfa8252af0399e345aa8b9bbb3b821.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96acd10>
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_96bfa8252af0399e345aa8b9bbb3b821.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_96bfa8252af0399e345aa8b9bbb3b821.jpg saved to cache
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_bb34dfc8538b231e8ad1871f8210b734.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fd110>
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F49%252F474970a5d757ce0f49b1827959711a48%252Fpa%252FJF63760_bb34dfc8538b231e8ad1871f8210b734.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_bb34dfc8538b231e8ad1871f8210b734.jpg saved to cache
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 744da18a-5210-5754-afe2-0642eb5dd641
2026-03-30 11:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 744da18a-5210-5754-afe2-0642eb5dd641, skipping ID generation
2026-03-30 11:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744da18a-5210-5754-afe2-0642eb5dd641 with scrape type 1
2026-03-30 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 744da18a-5210-5754-afe2-0642eb5dd641 sending to next pipeline
2026-03-30 11:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 744da18a-5210-5754-afe2-0642eb5dd641, identifier: JF63760
2026-03-30 11:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 744da18a-5210-5754-afe2-0642eb5dd641 with identifier: JF63760
2026-03-30 11:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 744da18a-5210-5754-afe2-0642eb5dd641 with identifier: JF63760
2026-03-30 11:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 744da18a-5210-5754-afe2-0642eb5dd641 with identifier: JF63760 to the API
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_bb34dfc8538b231e8ad1871f8210b734.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:45:49Z',
 'fuel_type': 'petrol',
 'id': '744da18a-5210-5754-afe2-0642eb5dd641',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF63760',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 138144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_bb34dfc8538b231e8ad1871f8210b734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_96bfa8252af0399e345aa8b9bbb3b821.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_b3dafe515660c4e47d9be38a6b106e08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_95b158c6ffb333b3a0acba9a773cdab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_aa3e2f97bebffeb9d3113598695b2f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_939493f9cdb7a75eb6276820b24f3c44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_d864fbf1a94d7753d789f4be79b9fdee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_a20a65366f8a4246a062db37ad106f73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_61e4fbbed08b6ce783d652e0fec3eec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_744da18a-5210-5754-afe2-0642eb5dd641/744da18a-5210-5754-afe2-0642eb5dd641_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/49/474970a5d757ce0f49b1827959711a48/pa/JF63760_9b171f3bcf5a97bf8be1a253e7097908.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF63760%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [auto1.be] INFO: Saving data for JF63760: {'created_time': 1774870590.092201, 'last_price_update_time': 1774870590.092211, 'auction_closing_time': 1774971949.0}
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF63760') HTTP/1.1" 204 0
2026-03-30 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU93857> (referer: https://www.auto1.com/v1/car-details-view/EU93857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a98a366a-2f42-56dc-9b16-37b72ff859bc with identifier: EU93857
2026-03-30 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a98a366a-2f42-56dc-9b16-37b72ff859bc with scrape type 1
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_9a37a9d91d1ede845b522ed9879db98f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9a37a9d91d1ede845b522ed9879db98f.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_a8356aa53901d0b409e3460d8a904dd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_a8356aa53901d0b409e3460d8a904dd1.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_e99670a1edefb6f1094e1e45c6fca85e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_e99670a1edefb6f1094e1e45c6fca85e.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_f95be5c5f10ef2a2f71721bc1b9cf38a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_f95be5c5f10ef2a2f71721bc1b9cf38a.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_63119fc9f4c861d8b987686b9126192e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_63119fc9f4c861d8b987686b9126192e.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_923b7a92bc4169c42bd2c72879c783db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_923b7a92bc4169c42bd2c72879c783db.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_7b1d6d72f14ddcfe443fb9076dfee9f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_7b1d6d72f14ddcfe443fb9076dfee9f9.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_456bd73810e12a7f52efd740fa08729f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_456bd73810e12a7f52efd740fa08729f.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_d3b9e59b7debfac2246f0df79b64f63b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_d3b9e59b7debfac2246f0df79b64f63b.jpg not downloaded yet
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_9123dc239289f83c4b674cc5b8f54e1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9123dc239289f83c4b674cc5b8f54e1e.jpg not downloaded yet
2026-03-30 11:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:36:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.091(s), this was the 1st time calling it.
2026-03-30 11:36:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.225040006237689 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA52655> (referer: https://www.auto1.com/v1/car-details-view/HA52655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9123dc239289f83c4b674cc5b8f54e1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a29c017-9d73-52b8-812f-2945b6510921 with identifier: HA52655
2026-03-30 11:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a29c017-9d73-52b8-812f-2945b6510921 with scrape type 1
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_100219205a290685eda94742cf293ca6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_100219205a290685eda94742cf293ca6.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_ba835b933b35fd71a0dac5637bed2fb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_ba835b933b35fd71a0dac5637bed2fb5.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_a00f92ce3761be4eeec087a9aac75cfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_a00f92ce3761be4eeec087a9aac75cfb.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_c58f4293f35dd599e81d09fa03950ac8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c58f4293f35dd599e81d09fa03950ac8.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_fbd5308ad9719b0c1258f55bda8d7108.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_fbd5308ad9719b0c1258f55bda8d7108.jpg not downloaded yet
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ff510>
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_9123dc239289f83c4b674cc5b8f54e1e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9123dc239289f83c4b674cc5b8f54e1e.jpg saved to cache
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_4ed6cbadecce6c9ca5800f23b1a45743.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_4ed6cbadecce6c9ca5800f23b1a45743.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_af86f61c49e994c2030826753c9316bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_af86f61c49e994c2030826753c9316bd.jpg not downloaded yet
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_c8089850f0d3a1b1989c712fc5120924.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c8089850f0d3a1b1989c712fc5120924.jpg not downloaded yet
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_d3b9e59b7debfac2246f0df79b64f63b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_c069d820bf26b9f4dec5e7a9b4cf08fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c069d820bf26b9f4dec5e7a9b4cf08fe.jpg not downloaded yet
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c8089850f0d3a1b1989c712fc5120924.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea214190>
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_d3b9e59b7debfac2246f0df79b64f63b.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_d3b9e59b7debfac2246f0df79b64f63b.jpg saved to cache
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c069d820bf26b9f4dec5e7a9b4cf08fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e959f490>
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_c8089850f0d3a1b1989c712fc5120924.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c8089850f0d3a1b1989c712fc5120924.jpg saved to cache
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_af86f61c49e994c2030826753c9316bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9822a50>
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_c069d820bf26b9f4dec5e7a9b4cf08fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c069d820bf26b9f4dec5e7a9b4cf08fe.jpg saved to cache
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e959f850>
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_af86f61c49e994c2030826753c9316bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_af86f61c49e994c2030826753c9316bd.jpg saved to cache
2026-03-30 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_4ed6cbadecce6c9ca5800f23b1a45743.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.848(s), this was the 1st time calling it.
2026-03-30 11:36:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.218629966812372 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e5510>
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_4ed6cbadecce6c9ca5800f23b1a45743.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_4ed6cbadecce6c9ca5800f23b1a45743.jpg saved to cache
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_fbd5308ad9719b0c1258f55bda8d7108.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22c6d0>
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_fbd5308ad9719b0c1258f55bda8d7108.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_fbd5308ad9719b0c1258f55bda8d7108.jpg saved to cache
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c58f4293f35dd599e81d09fa03950ac8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_a00f92ce3761be4eeec087a9aac75cfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97864d0>
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_c58f4293f35dd599e81d09fa03950ac8.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c58f4293f35dd599e81d09fa03950ac8.jpg saved to cache
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9787990>
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_a00f92ce3761be4eeec087a9aac75cfb.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_a00f92ce3761be4eeec087a9aac75cfb.jpg saved to cache
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_ba835b933b35fd71a0dac5637bed2fb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea10df90>
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_ba835b933b35fd71a0dac5637bed2fb5.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_ba835b933b35fd71a0dac5637bed2fb5.jpg saved to cache
2026-03-30 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_100219205a290685eda94742cf293ca6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97844d0>
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_100219205a290685eda94742cf293ca6.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_100219205a290685eda94742cf293ca6.jpg saved to cache
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22c2d0>
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fd3%252F74d343aa639964c105640babd9d8d5fb%252Fpa%252FHA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg saved to cache
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a29c017-9d73-52b8-812f-2945b6510921
2026-03-30 11:36:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a29c017-9d73-52b8-812f-2945b6510921, skipping ID generation
2026-03-30 11:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a29c017-9d73-52b8-812f-2945b6510921 with scrape type 1
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a29c017-9d73-52b8-812f-2945b6510921 sending to next pipeline
2026-03-30 11:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6a29c017-9d73-52b8-812f-2945b6510921, identifier: HA52655
2026-03-30 11:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6a29c017-9d73-52b8-812f-2945b6510921 with identifier: HA52655
2026-03-30 11:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6a29c017-9d73-52b8-812f-2945b6510921 with identifier: HA52655
2026-03-30 11:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6a29c017-9d73-52b8-812f-2945b6510921 with identifier: HA52655 to the API
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-03-31T15:52:54Z',
 'fuel_type': 'petrol',
 'id': '6a29c017-9d73-52b8-812f-2945b6510921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA52655',
 'listing': 'auction',
 'location': 'BE, Retie',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 130947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_66c8f2980ac76aad773f20ebfd247fe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_100219205a290685eda94742cf293ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_ba835b933b35fd71a0dac5637bed2fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_a00f92ce3761be4eeec087a9aac75cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c58f4293f35dd599e81d09fa03950ac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_fbd5308ad9719b0c1258f55bda8d7108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_4ed6cbadecce6c9ca5800f23b1a45743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_af86f61c49e994c2030826753c9316bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c8089850f0d3a1b1989c712fc5120924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a29c017-9d73-52b8-812f-2945b6510921/6a29c017-9d73-52b8-812f-2945b6510921_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/d3/74d343aa639964c105640babd9d8d5fb/pa/HA52655_c069d820bf26b9f4dec5e7a9b4cf08fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA52655%27 HTTP/1.1" 200 None
2026-03-30 11:36:36 [auto1.be] INFO: Saving data for HA52655: {'created_time': 1774870596.610372, 'last_price_update_time': 1774870596.610382, 'auction_closing_time': 1774972374.0}
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HA52655') HTTP/1.1" 204 0
2026-03-30 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_456bd73810e12a7f52efd740fa08729f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9830cd0>
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_456bd73810e12a7f52efd740fa08729f.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_456bd73810e12a7f52efd740fa08729f.jpg saved to cache
2026-03-30 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_7b1d6d72f14ddcfe443fb9076dfee9f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_923b7a92bc4169c42bd2c72879c783db.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e959e190>
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_7b1d6d72f14ddcfe443fb9076dfee9f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_7b1d6d72f14ddcfe443fb9076dfee9f9.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9821c50>
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_923b7a92bc4169c42bd2c72879c783db.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_923b7a92bc4169c42bd2c72879c783db.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_63119fc9f4c861d8b987686b9126192e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981b010>
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_63119fc9f4c861d8b987686b9126192e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_63119fc9f4c861d8b987686b9126192e.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_f95be5c5f10ef2a2f71721bc1b9cf38a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_e99670a1edefb6f1094e1e45c6fca85e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e3690>
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_f95be5c5f10ef2a2f71721bc1b9cf38a.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_f95be5c5f10ef2a2f71721bc1b9cf38a.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97eb610>
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_e99670a1edefb6f1094e1e45c6fca85e.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_e99670a1edefb6f1094e1e45c6fca85e.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_a8356aa53901d0b409e3460d8a904dd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9a37a9d91d1ede845b522ed9879db98f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e85d0>
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_a8356aa53901d0b409e3460d8a904dd1.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_a8356aa53901d0b409e3460d8a904dd1.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22cc10>
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F74%252Fd3749aeb93259f542e63713f9bb34e10%252Fpa%252FEU93857_9a37a9d91d1ede845b522ed9879db98f.jpg') HTTP/1.1" 204 0
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9a37a9d91d1ede845b522ed9879db98f.jpg saved to cache
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a98a366a-2f42-56dc-9b16-37b72ff859bc
2026-03-30 11:36:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a98a366a-2f42-56dc-9b16-37b72ff859bc, skipping ID generation
2026-03-30 11:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a98a366a-2f42-56dc-9b16-37b72ff859bc with scrape type 1
2026-03-30 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a98a366a-2f42-56dc-9b16-37b72ff859bc sending to next pipeline
2026-03-30 11:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a98a366a-2f42-56dc-9b16-37b72ff859bc, identifier: EU93857
2026-03-30 11:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a98a366a-2f42-56dc-9b16-37b72ff859bc with identifier: EU93857
2026-03-30 11:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a98a366a-2f42-56dc-9b16-37b72ff859bc with identifier: EU93857
2026-03-30 11:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a98a366a-2f42-56dc-9b16-37b72ff859bc with identifier: EU93857 to the API
2026-03-30 11:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9a37a9d91d1ede845b522ed9879db98f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:14:00Z',
 'fuel_type': 'petrol',
 'id': 'a98a366a-2f42-56dc-9b16-37b72ff859bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU93857',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 117079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9a37a9d91d1ede845b522ed9879db98f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_a8356aa53901d0b409e3460d8a904dd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_e99670a1edefb6f1094e1e45c6fca85e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_f95be5c5f10ef2a2f71721bc1b9cf38a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_63119fc9f4c861d8b987686b9126192e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_923b7a92bc4169c42bd2c72879c783db.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_7b1d6d72f14ddcfe443fb9076dfee9f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_456bd73810e12a7f52efd740fa08729f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_d3b9e59b7debfac2246f0df79b64f63b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98a366a-2f42-56dc-9b16-37b72ff859bc/a98a366a-2f42-56dc-9b16-37b72ff859bc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/74/d3749aeb93259f542e63713f9bb34e10/pa/EU93857_9123dc239289f83c4b674cc5b8f54e1e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.2 PureTech Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2018}
2026-03-30 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU93857%27 HTTP/1.1" 200 None
2026-03-30 11:36:39 [auto1.be] INFO: Saving data for EU93857: {'created_time': 1774870599.290291, 'last_price_update_time': 1774870599.2903, 'auction_closing_time': 1774970040.0}
2026-03-30 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU93857') HTTP/1.1" 204 0
2026-03-30 11:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV35252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN16756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC77463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS95639> (referer: https://www.auto1.com/v1/car-details-view/XS95639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9c91430-ae0b-5834-b588-1a4e685cd060 with identifier: XS95639
2026-03-30 11:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9c91430-ae0b-5834-b588-1a4e685cd060 with scrape type 1
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_638be53e1746dd8f40f62706be81e73e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_638be53e1746dd8f40f62706be81e73e.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_8ca6ae014c18668629feb8f7dd78dcfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_8ca6ae014c18668629feb8f7dd78dcfe.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_4438b3e4cffbf3448aa4258803820a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_4438b3e4cffbf3448aa4258803820a18.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_12716f198d428935c7ec653317ba8399.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_12716f198d428935c7ec653317ba8399.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_29492d4ae48e09b01fd4f8a32ec4c67b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_29492d4ae48e09b01fd4f8a32ec4c67b.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_826082833e012b5bbe2601f54d5dac10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_826082833e012b5bbe2601f54d5dac10.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_ee8d7558aa4f6cbf0293b7f516040ba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_ee8d7558aa4f6cbf0293b7f516040ba6.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_7f45534c1a5c6aa2a61039554f125b0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_7f45534c1a5c6aa2a61039554f125b0e.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_2d603297cd9491e3b46425f4626d80ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_2d603297cd9491e3b46425f4626d80ca.jpg not downloaded yet
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_051152e06d33f950eecae186816824f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_051152e06d33f950eecae186816824f4.jpg not downloaded yet
2026-03-30 11:37:07 [scrapy.extensions.logstats] INFO: Crawled 114 pages (at 13 pages/min), scraped 72 items (at 8 items/min)
2026-03-30 11:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:37:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.712(s), this was the 1st time calling it.
2026-03-30 11:37:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6000034841956428 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:37:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.964(s), this was the 1st time calling it.
2026-03-30 11:37:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.032329401732651 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG16192> (referer: https://www.auto1.com/v1/car-details-view/WG16192/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6 with identifier: WG16192
2026-03-30 11:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6 with scrape type 1
2026-03-30 11:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6
2026-03-30 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_cf5e94da56d9f3b9e8167fb21a14dda7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_cf5e94da56d9f3b9e8167fb21a14dda7.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_a7f2755ac043b577b292a8558283944c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_a7f2755ac043b577b292a8558283944c.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_f682f62d4cded943e00bfad6658cbbda.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_f682f62d4cded943e00bfad6658cbbda.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_d0964b6c333e9919d628dd65ca7b8743.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_d0964b6c333e9919d628dd65ca7b8743.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_96698fc47b34f2dd9a670669047bcbbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_96698fc47b34f2dd9a670669047bcbbe.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_7b7e531756d5b48b093d250059729879.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_7b7e531756d5b48b093d250059729879.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_18a28ab495ad266c1a0d5fba1ba9827c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_18a28ab495ad266c1a0d5fba1ba9827c.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_85d62c76572397fdcca734ff6323dc52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_85d62c76572397fdcca734ff6323dc52.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_df0adb13ddba65ff793e662dade2a231.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_df0adb13ddba65ff793e662dade2a231.jpg already downloaded
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fd6%252F91d61e7a4eb1f115e0719cc8e34e8aae%252Fpa%252FWG16192_63daf027da574999d8091849d106d1f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_63daf027da574999d8091849d106d1f2.jpg already downloaded
2026-03-30 11:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6, identifier: WG16192
2026-03-30 11:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6 with identifier: WG16192
2026-03-30 11:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6 with identifier: WG16192
2026-03-30 11:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f133f89-bfe3-595e-9f79-8bca1bd8a3a6 with identifier: WG16192 to the API
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG16192>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:03Z',
 'fuel_type': 'diesel',
 'id': '1f133f89-bfe3-595e-9f79-8bca1bd8a3a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG16192',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 207003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_cf5e94da56d9f3b9e8167fb21a14dda7.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_a7f2755ac043b577b292a8558283944c.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_f682f62d4cded943e00bfad6658cbbda.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_d0964b6c333e9919d628dd65ca7b8743.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_96698fc47b34f2dd9a670669047bcbbe.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_7b7e531756d5b48b093d250059729879.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_18a28ab495ad266c1a0d5fba1ba9827c.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_85d62c76572397fdcca734ff6323dc52.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_df0adb13ddba65ff793e662dade2a231.jpg',
                'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_63daf027da574999d8091849d106d1f2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_cf5e94da56d9f3b9e8167fb21a14dda7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3301621,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_a7f2755ac043b577b292a8558283944c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3316709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_f682f62d4cded943e00bfad6658cbbda.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_d0964b6c333e9919d628dd65ca7b8743.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3049249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_96698fc47b34f2dd9a670669047bcbbe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3212462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_7b7e531756d5b48b093d250059729879.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_18a28ab495ad266c1a0d5fba1ba9827c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3509565,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_85d62c76572397fdcca734ff6323dc52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3106477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_df0adb13ddba65ff793e662dade2a231.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f133f89-bfe3-595e-9f79-8bca1bd8a3a6/1f133f89-bfe3-595e-9f79-8bca1bd8a3a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/d6/91d61e7a4eb1f115e0719cc8e34e8aae/pa/WG16192_63daf027da574999d8091849d106d1f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Intense 4WD',
 'transmission': 'manual',
 'trim': 'Intense 4WD',
 'year': 2015}
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG16192%27 HTTP/1.1" 200 None
2026-03-30 11:37:46 [auto1.be] INFO: Saving data for WG16192: {'created_time': 1774870666.620202, 'last_price_update_time': 1774870666.620213, 'auction_closing_time': 1774972083.0}
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG16192') HTTP/1.1" 204 0
2026-03-30 11:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_051152e06d33f950eecae186816824f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_2d603297cd9491e3b46425f4626d80ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e9a10>
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_051152e06d33f950eecae186816824f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_051152e06d33f950eecae186816824f4.jpg saved to cache
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_7f45534c1a5c6aa2a61039554f125b0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e4590>
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_2d603297cd9491e3b46425f4626d80ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_2d603297cd9491e3b46425f4626d80ca.jpg saved to cache
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_ee8d7558aa4f6cbf0293b7f516040ba6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b3a10>
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_7f45534c1a5c6aa2a61039554f125b0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_7f45534c1a5c6aa2a61039554f125b0e.jpg saved to cache
2026-03-30 11:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_826082833e012b5bbe2601f54d5dac10.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981b950>
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_ee8d7558aa4f6cbf0293b7f516040ba6.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_ee8d7558aa4f6cbf0293b7f516040ba6.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_29492d4ae48e09b01fd4f8a32ec4c67b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ad910>
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_826082833e012b5bbe2601f54d5dac10.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_826082833e012b5bbe2601f54d5dac10.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_12716f198d428935c7ec653317ba8399.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e4610>
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_29492d4ae48e09b01fd4f8a32ec4c67b.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_29492d4ae48e09b01fd4f8a32ec4c67b.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_4438b3e4cffbf3448aa4258803820a18.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96af050>
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_12716f198d428935c7ec653317ba8399.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_12716f198d428935c7ec653317ba8399.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_8ca6ae014c18668629feb8f7dd78dcfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9830a10>
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_4438b3e4cffbf3448aa4258803820a18.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_4438b3e4cffbf3448aa4258803820a18.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_638be53e1746dd8f40f62706be81e73e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e6090>
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_8ca6ae014c18668629feb8f7dd78dcfe.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_8ca6ae014c18668629feb8f7dd78dcfe.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1310d0>
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1c%252F35%252F1c359ff915ce5b999520c5e19049ea60%252Fpa%252FXS95639_638be53e1746dd8f40f62706be81e73e.jpg') HTTP/1.1" 204 0
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_638be53e1746dd8f40f62706be81e73e.jpg saved to cache
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9c91430-ae0b-5834-b588-1a4e685cd060
2026-03-30 11:37:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9c91430-ae0b-5834-b588-1a4e685cd060, skipping ID generation
2026-03-30 11:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9c91430-ae0b-5834-b588-1a4e685cd060 with scrape type 1
2026-03-30 11:37:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9c91430-ae0b-5834-b588-1a4e685cd060 sending to next pipeline
2026-03-30 11:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9c91430-ae0b-5834-b588-1a4e685cd060, identifier: XS95639
2026-03-30 11:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9c91430-ae0b-5834-b588-1a4e685cd060 with identifier: XS95639
2026-03-30 11:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9c91430-ae0b-5834-b588-1a4e685cd060 with identifier: XS95639
2026-03-30 11:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9c91430-ae0b-5834-b588-1a4e685cd060 with identifier: XS95639 to the API
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_638be53e1746dd8f40f62706be81e73e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:54:34Z',
 'fuel_type': 'petrol',
 'id': 'a9c91430-ae0b-5834-b588-1a4e685cd060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS95639',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 150273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_638be53e1746dd8f40f62706be81e73e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_8ca6ae014c18668629feb8f7dd78dcfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_4438b3e4cffbf3448aa4258803820a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_12716f198d428935c7ec653317ba8399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_29492d4ae48e09b01fd4f8a32ec4c67b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_826082833e012b5bbe2601f54d5dac10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_ee8d7558aa4f6cbf0293b7f516040ba6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_7f45534c1a5c6aa2a61039554f125b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_2d603297cd9491e3b46425f4626d80ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c91430-ae0b-5834-b588-1a4e685cd060/a9c91430-ae0b-5834-b588-1a4e685cd060_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1c/35/1c359ff915ce5b999520c5e19049ea60/pa/XS95639_051152e06d33f950eecae186816824f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS95639%27 HTTP/1.1" 200 None
2026-03-30 11:37:47 [auto1.be] INFO: Saving data for XS95639: {'created_time': 1774870667.945017, 'last_price_update_time': 1774870667.945029, 'auction_closing_time': 1774972474.0}
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS95639') HTTP/1.1" 204 0
2026-03-30 11:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:37:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.656(s), this was the 1st time calling it.
2026-03-30 11:37:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.189458584271174 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA37165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD88636> (referer: https://www.auto1.com/v1/car-details-view/LD88636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9648c67a-1f8b-561b-8cad-02e3830ae2b9 with identifier: LD88636
2026-03-30 11:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9648c67a-1f8b-561b-8cad-02e3830ae2b9 with scrape type 1
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9648c67a-1f8b-561b-8cad-02e3830ae2b9
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_d9d7709f8700b7bc4d3420708eda9bce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_d9d7709f8700b7bc4d3420708eda9bce.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_321d81ef1066e3ae96df420a99f3ceb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_321d81ef1066e3ae96df420a99f3ceb9.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_e6f8503d52d48bd46ff1006353b8a7fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_e6f8503d52d48bd46ff1006353b8a7fd.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_ea5fd0478ab9321129f5a20998da8683.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_ea5fd0478ab9321129f5a20998da8683.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_14f2ff4ab4c7a5896c70c3b29471d306.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_14f2ff4ab4c7a5896c70c3b29471d306.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_9b2b5b167ea98c992640fd57943edbe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_9b2b5b167ea98c992640fd57943edbe4.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_2a465a914514f32862c9d420be006389.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_2a465a914514f32862c9d420be006389.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_d9c376566b9e555c77a11d08b4c8ff88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_d9c376566b9e555c77a11d08b4c8ff88.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_1c7aef5de16665093d5c24b7632e065f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_1c7aef5de16665093d5c24b7632e065f.jpg already downloaded
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F0a%252F370a9d7d7283e154a88d38c0c75f7103%252Fpa%252FLD88636_3390e3dabfe116cd8a314caf3731a0f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_3390e3dabfe116cd8a314caf3731a0f4.jpg already downloaded
2026-03-30 11:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9648c67a-1f8b-561b-8cad-02e3830ae2b9, identifier: LD88636
2026-03-30 11:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9648c67a-1f8b-561b-8cad-02e3830ae2b9 with identifier: LD88636
2026-03-30 11:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9648c67a-1f8b-561b-8cad-02e3830ae2b9 with identifier: LD88636
2026-03-30 11:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9648c67a-1f8b-561b-8cad-02e3830ae2b9 with identifier: LD88636 to the API
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD88636>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:37:07Z',
 'fuel_type': 'petrol',
 'id': '9648c67a-1f8b-561b-8cad-02e3830ae2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD88636',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '3er',
 'odometer': 128469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_d9d7709f8700b7bc4d3420708eda9bce.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_321d81ef1066e3ae96df420a99f3ceb9.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_e6f8503d52d48bd46ff1006353b8a7fd.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_ea5fd0478ab9321129f5a20998da8683.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_14f2ff4ab4c7a5896c70c3b29471d306.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_9b2b5b167ea98c992640fd57943edbe4.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_2a465a914514f32862c9d420be006389.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_d9c376566b9e555c77a11d08b4c8ff88.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_1c7aef5de16665093d5c24b7632e065f.jpg',
                'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_3390e3dabfe116cd8a314caf3731a0f4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_d9d7709f8700b7bc4d3420708eda9bce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_321d81ef1066e3ae96df420a99f3ceb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_e6f8503d52d48bd46ff1006353b8a7fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_ea5fd0478ab9321129f5a20998da8683.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_14f2ff4ab4c7a5896c70c3b29471d306.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_9b2b5b167ea98c992640fd57943edbe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_2a465a914514f32862c9d420be006389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_d9c376566b9e555c77a11d08b4c8ff88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_1c7aef5de16665093d5c24b7632e065f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9648c67a-1f8b-561b-8cad-02e3830ae2b9/9648c67a-1f8b-561b-8cad-02e3830ae2b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/0a/370a9d7d7283e154a88d38c0c75f7103/pa/LD88636_3390e3dabfe116cd8a314caf3731a0f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD88636%27 HTTP/1.1" 200 None
2026-03-30 11:37:59 [auto1.be] INFO: Saving data for LD88636: {'created_time': 1774870679.847897, 'last_price_update_time': 1774870679.847909, 'auction_closing_time': 1774971427.0}
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LD88636') HTTP/1.1" 204 0
2026-03-30 11:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM25076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW30540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:07 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 5 pages/min), scraped 75 items (at 3 items/min)
2026-03-30 11:38:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD24898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES37809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV35252> (referer: https://www.auto1.com/v1/car-details-view/KV35252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d87bf06-ff1e-53b6-aa6b-8230304fe915 with identifier: KV35252
2026-03-30 11:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915 with scrape type 1
2026-03-30 11:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg not downloaded yet
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_a3616a3c07b9155dd7a32e7a9bf880af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_a3616a3c07b9155dd7a32e7a9bf880af.jpg not downloaded yet
2026-03-30 11:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_f38c24ad9327196cae3d68fe728b4f7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f38c24ad9327196cae3d68fe728b4f7a.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_825026c7ab9155e45ba2b86e0512bd0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_825026c7ab9155e45ba2b86e0512bd0a.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_c68def45fe582f7167cbb6470ffaa478.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_c68def45fe582f7167cbb6470ffaa478.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_56a6d41a9c271dcd3f8df06b02cabb80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_56a6d41a9c271dcd3f8df06b02cabb80.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_eaa7466e368480ad4a41a7319588b3a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_eaa7466e368480ad4a41a7319588b3a6.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_f63bd4e5dc9da36bc8e6eeda89107181.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f63bd4e5dc9da36bc8e6eeda89107181.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_dc460aec762512d91a32fdc653cb76c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_dc460aec762512d91a32fdc653cb76c2.jpg not downloaded yet
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_2b23c1ca763bb0ad1bb971ba63913cb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_2b23c1ca763bb0ad1bb971ba63913cb9.jpg not downloaded yet
2026-03-30 11:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC77463> (referer: https://www.auto1.com/v1/car-details-view/VC77463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_2b23c1ca763bb0ad1bb971ba63913cb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100bea49-645b-5756-ae84-8c526da6c4e5 with identifier: VC77463
2026-03-30 11:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100bea49-645b-5756-ae84-8c526da6c4e5 with scrape type 1
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 100bea49-645b-5756-ae84-8c526da6c4e5
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_9684eda510c4e3202c3a0f5b434fad6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_9684eda510c4e3202c3a0f5b434fad6a.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_a6898662892e9d888313eff0716c895d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_a6898662892e9d888313eff0716c895d.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_501da50d28a3c653f6dcc03ba198cc41.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_501da50d28a3c653f6dcc03ba198cc41.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_626c30a16ec8a695e280cc37d496ebf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_626c30a16ec8a695e280cc37d496ebf0.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_d09b0dbb5816bcd655d32aa047b0e3f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_d09b0dbb5816bcd655d32aa047b0e3f4.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_01d5481edc6d7329f2150e9c05d015a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_01d5481edc6d7329f2150e9c05d015a8.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_8f7a374ccf9d96d7a81b1ba966cad5e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_8f7a374ccf9d96d7a81b1ba966cad5e9.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_827627d1d787b6ea5a7397b7fca3a9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_827627d1d787b6ea5a7397b7fca3a9e5.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_0e975ca4a39a580de27080243d778c1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_0e975ca4a39a580de27080243d778c1f.jpg already downloaded
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F12%252F3912b444adff7369eef70e89f5194bdc%252Fpa%252FVC77463_db8e7b88262769fbfc699dfd0a6f59e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_db8e7b88262769fbfc699dfd0a6f59e6.jpg already downloaded
2026-03-30 11:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 100bea49-645b-5756-ae84-8c526da6c4e5, identifier: VC77463
2026-03-30 11:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 100bea49-645b-5756-ae84-8c526da6c4e5 with identifier: VC77463
2026-03-30 11:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 100bea49-645b-5756-ae84-8c526da6c4e5 with identifier: VC77463
2026-03-30 11:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 100bea49-645b-5756-ae84-8c526da6c4e5 with identifier: VC77463 to the API
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VC77463>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:40:11Z',
 'fuel_type': 'diesel',
 'id': '100bea49-645b-5756-ae84-8c526da6c4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC77463',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '4er',
 'odometer': 116618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_9684eda510c4e3202c3a0f5b434fad6a.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_a6898662892e9d888313eff0716c895d.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_501da50d28a3c653f6dcc03ba198cc41.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_626c30a16ec8a695e280cc37d496ebf0.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_d09b0dbb5816bcd655d32aa047b0e3f4.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_01d5481edc6d7329f2150e9c05d015a8.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_8f7a374ccf9d96d7a81b1ba966cad5e9.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_827627d1d787b6ea5a7397b7fca3a9e5.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_0e975ca4a39a580de27080243d778c1f.jpg',
                'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_db8e7b88262769fbfc699dfd0a6f59e6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344429,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_9684eda510c4e3202c3a0f5b434fad6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_a6898662892e9d888313eff0716c895d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2390763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_501da50d28a3c653f6dcc03ba198cc41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_626c30a16ec8a695e280cc37d496ebf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_d09b0dbb5816bcd655d32aa047b0e3f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_01d5481edc6d7329f2150e9c05d015a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_8f7a374ccf9d96d7a81b1ba966cad5e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430657,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_827627d1d787b6ea5a7397b7fca3a9e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_0e975ca4a39a580de27080243d778c1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_100bea49-645b-5756-ae84-8c526da6c4e5/100bea49-645b-5756-ae84-8c526da6c4e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/12/3912b444adff7369eef70e89f5194bdc/pa/VC77463_db8e7b88262769fbfc699dfd0a6f59e6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC77463%27 HTTP/1.1" 200 None
2026-03-30 11:38:14 [auto1.be] INFO: Saving data for VC77463: {'created_time': 1774870694.643761, 'last_price_update_time': 1774870694.643772, 'auction_closing_time': 1774971611.0}
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VC77463') HTTP/1.1" 204 0
2026-03-30 11:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_dc460aec762512d91a32fdc653cb76c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e4dd0>
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_2b23c1ca763bb0ad1bb971ba63913cb9.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_2b23c1ca763bb0ad1bb971ba63913cb9.jpg saved to cache
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0bcf90>
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_dc460aec762512d91a32fdc653cb76c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_dc460aec762512d91a32fdc653cb76c2.jpg saved to cache
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f63bd4e5dc9da36bc8e6eeda89107181.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_eaa7466e368480ad4a41a7319588b3a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98267d0>
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_f63bd4e5dc9da36bc8e6eeda89107181.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f63bd4e5dc9da36bc8e6eeda89107181.jpg saved to cache
2026-03-30 11:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_56a6d41a9c271dcd3f8df06b02cabb80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ebe90>
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_eaa7466e368480ad4a41a7319588b3a6.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_eaa7466e368480ad4a41a7319588b3a6.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_c68def45fe582f7167cbb6470ffaa478.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ffb90>
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_56a6d41a9c271dcd3f8df06b02cabb80.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_56a6d41a9c271dcd3f8df06b02cabb80.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_825026c7ab9155e45ba2b86e0512bd0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96fff10>
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_c68def45fe582f7167cbb6470ffaa478.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_c68def45fe582f7167cbb6470ffaa478.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f38c24ad9327196cae3d68fe728b4f7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0be710>
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_825026c7ab9155e45ba2b86e0512bd0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_825026c7ab9155e45ba2b86e0512bd0a.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_a3616a3c07b9155dd7a32e7a9bf880af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0bcc90>
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_f38c24ad9327196cae3d68fe728b4f7a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f38c24ad9327196cae3d68fe728b4f7a.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1312d0>
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_a3616a3c07b9155dd7a32e7a9bf880af.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_a3616a3c07b9155dd7a32e7a9bf880af.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e5910>
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe4%252F02e4751e77e7889eb44a87f1e6321f6b%252Fpa%252FKV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg saved to cache
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915
2026-03-30 11:38:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d87bf06-ff1e-53b6-aa6b-8230304fe915, skipping ID generation
2026-03-30 11:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915 with scrape type 1
2026-03-30 11:38:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d87bf06-ff1e-53b6-aa6b-8230304fe915 sending to next pipeline
2026-03-30 11:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d87bf06-ff1e-53b6-aa6b-8230304fe915, identifier: KV35252
2026-03-30 11:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d87bf06-ff1e-53b6-aa6b-8230304fe915 with identifier: KV35252
2026-03-30 11:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d87bf06-ff1e-53b6-aa6b-8230304fe915 with identifier: KV35252
2026-03-30 11:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d87bf06-ff1e-53b6-aa6b-8230304fe915 with identifier: KV35252 to the API
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 98,
 'expiration_date': '2026-03-31T15:31:27Z',
 'fuel_type': 'petrol',
 'id': '4d87bf06-ff1e-53b6-aa6b-8230304fe915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV35252',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 110150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 425468,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_66f198ed744bc2e7413be1a1cd7a6b06.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_a3616a3c07b9155dd7a32e7a9bf880af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f38c24ad9327196cae3d68fe728b4f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_825026c7ab9155e45ba2b86e0512bd0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_c68def45fe582f7167cbb6470ffaa478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_56a6d41a9c271dcd3f8df06b02cabb80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_eaa7466e368480ad4a41a7319588b3a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_f63bd4e5dc9da36bc8e6eeda89107181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_dc460aec762512d91a32fdc653cb76c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d87bf06-ff1e-53b6-aa6b-8230304fe915/4d87bf06-ff1e-53b6-aa6b-8230304fe915_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/e4/02e4751e77e7889eb44a87f1e6321f6b/pa/KV35252_2b23c1ca763bb0ad1bb971ba63913cb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV35252%27 HTTP/1.1" 200 None
2026-03-30 11:38:15 [auto1.be] INFO: Saving data for KV35252: {'created_time': 1774870695.954637, 'last_price_update_time': 1774870695.954647, 'auction_closing_time': 1774971087.0}
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV35252') HTTP/1.1" 204 0
2026-03-30 11:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN16756> (referer: https://www.auto1.com/v1/car-details-view/WN16756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 322c55e4-28f1-59c5-ad21-1299942c89e9 with identifier: WN16756
2026-03-30 11:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322c55e4-28f1-59c5-ad21-1299942c89e9 with scrape type 1
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_99284397d70895dd864b96dd92c8c475.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_99284397d70895dd864b96dd92c8c475.jpg not downloaded yet
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_025cd2164a9c5ec533a02d7b02fd8961.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_025cd2164a9c5ec533a02d7b02fd8961.jpg not downloaded yet
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_2b65f820e655dd17e1f068a2abb2c692.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_2b65f820e655dd17e1f068a2abb2c692.jpg not downloaded yet
2026-03-30 11:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH36380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg not downloaded yet
2026-03-30 11:38:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_72c7ca1cad762e587deed9cddff51837.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_72c7ca1cad762e587deed9cddff51837.jpg not downloaded yet
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_6bf990c5688862a83299644e1380e1b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_6bf990c5688862a83299644e1380e1b0.jpg not downloaded yet
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_113333cc95a7f36c8aa9f677fe60185b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_113333cc95a7f36c8aa9f677fe60185b.jpg not downloaded yet
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_996c96131593efb5f5033ff5d91089f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_996c96131593efb5f5033ff5d91089f7.jpg not downloaded yet
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_d650197e25bb0baa117deae7ccc861e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_d650197e25bb0baa117deae7ccc861e9.jpg not downloaded yet
2026-03-30 11:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_2b65f820e655dd17e1f068a2abb2c692.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_dbfbf67d4ee82399a3ba5270f21249b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_dbfbf67d4ee82399a3ba5270f21249b4.jpg not downloaded yet
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9787350>
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_2b65f820e655dd17e1f068a2abb2c692.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_2b65f820e655dd17e1f068a2abb2c692.jpg saved to cache
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_996c96131593efb5f5033ff5d91089f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9860210>
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_996c96131593efb5f5033ff5d91089f7.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_996c96131593efb5f5033ff5d91089f7.jpg saved to cache
2026-03-30 11:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA37165> (referer: https://www.auto1.com/v1/car-details-view/GA37165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 with identifier: GA37165
2026-03-30 11:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 with scrape type 1
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_816c752b8dd3723613c6a4db54ff20ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_816c752b8dd3723613c6a4db54ff20ab.jpg not downloaded yet
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_47bcb1bead1374390c1123c23068dc6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_47bcb1bead1374390c1123c23068dc6d.jpg not downloaded yet
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_9e9a0d47dfe00d4b5e60faa202133d88.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_9e9a0d47dfe00d4b5e60faa202133d88.jpg not downloaded yet
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_2b05d480eedac473f87d9cf5c53eb6f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2b05d480eedac473f87d9cf5c53eb6f2.jpg not downloaded yet
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_0622838c1a94ec271ecfa519fec8b9b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_0622838c1a94ec271ecfa519fec8b9b9.jpg not downloaded yet
2026-03-30 11:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_dbfbf67d4ee82399a3ba5270f21249b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_2c8e711cf80082f92197f7e60b28cdcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2c8e711cf80082f92197f7e60b28cdcb.jpg not downloaded yet
2026-03-30 11:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY10486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_418af090fab13bddd63fcd38285bc914.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_418af090fab13bddd63fcd38285bc914.jpg not downloaded yet
2026-03-30 11:38:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_4390672bd2dbea1d64204baf1b3d7e45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_4390672bd2dbea1d64204baf1b3d7e45.jpg not downloaded yet
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_95f6c0daa7bb570ff8eba5ba6aa4f806.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_95f6c0daa7bb570ff8eba5ba6aa4f806.jpg not downloaded yet
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_89f3a6a4c0e75403acc6c573d9af0126.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_89f3a6a4c0e75403acc6c573d9af0126.jpg not downloaded yet
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ff0d0>
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_dbfbf67d4ee82399a3ba5270f21249b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_dbfbf67d4ee82399a3ba5270f21249b4.jpg saved to cache
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_0622838c1a94ec271ecfa519fec8b9b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975c250>
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_0622838c1a94ec271ecfa519fec8b9b9.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_0622838c1a94ec271ecfa519fec8b9b9.jpg saved to cache
2026-03-30 11:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2c8e711cf80082f92197f7e60b28cdcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_89f3a6a4c0e75403acc6c573d9af0126.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2183d0>
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_2c8e711cf80082f92197f7e60b28cdcb.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2c8e711cf80082f92197f7e60b28cdcb.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9827750>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_89f3a6a4c0e75403acc6c573d9af0126.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_89f3a6a4c0e75403acc6c573d9af0126.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY31079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_4390672bd2dbea1d64204baf1b3d7e45.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_95f6c0daa7bb570ff8eba5ba6aa4f806.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_418af090fab13bddd63fcd38285bc914.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea21acd0>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_4390672bd2dbea1d64204baf1b3d7e45.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_4390672bd2dbea1d64204baf1b3d7e45.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9874150>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_95f6c0daa7bb570ff8eba5ba6aa4f806.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_95f6c0daa7bb570ff8eba5ba6aa4f806.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96db110>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_418af090fab13bddd63fcd38285bc914.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_418af090fab13bddd63fcd38285bc914.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM25076> (referer: https://www.auto1.com/v1/car-details-view/SM25076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2b05d480eedac473f87d9cf5c53eb6f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_9e9a0d47dfe00d4b5e60faa202133d88.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_816c752b8dd3723613c6a4db54ff20ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_47bcb1bead1374390c1123c23068dc6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8690a729-5ecb-5c68-91cf-ad89c21d3142 with identifier: SM25076
2026-03-30 11:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8690a729-5ecb-5c68-91cf-ad89c21d3142 with scrape type 1
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_c7941d1109993c57ec69df15d3b64c7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_c7941d1109993c57ec69df15d3b64c7b.jpg not downloaded yet
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_2122d88d2a11d55906c93c6edb37f73b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2122d88d2a11d55906c93c6edb37f73b.jpg not downloaded yet
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_523cbddcac9803d00022845e118211c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_523cbddcac9803d00022845e118211c6.jpg not downloaded yet
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e5150>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_2b05d480eedac473f87d9cf5c53eb6f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2b05d480eedac473f87d9cf5c53eb6f2.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_30b5a975f295e7b4eb3fecb86eee758e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_30b5a975f295e7b4eb3fecb86eee758e.jpg not downloaded yet
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a4810>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_9e9a0d47dfe00d4b5e60faa202133d88.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_9e9a0d47dfe00d4b5e60faa202133d88.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_d650197e25bb0baa117deae7ccc861e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_113333cc95a7f36c8aa9f677fe60185b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_ee487aaaf2c13f4a205ec1031b70940e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_ee487aaaf2c13f4a205ec1031b70940e.jpg not downloaded yet
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e21d0>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_816c752b8dd3723613c6a4db54ff20ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_816c752b8dd3723613c6a4db54ff20ab.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea214d10>
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F1a%252F3f1a0426f5e3e328a1122a8456595f21%252Fpa%252FGA37165_47bcb1bead1374390c1123c23068dc6d.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_47bcb1bead1374390c1123c23068dc6d.jpg saved to cache
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94
2026-03-30 11:38:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35b6a7b7-2e19-5823-887d-f5b0c2f64a94, skipping ID generation
2026-03-30 11:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 with scrape type 1
2026-03-30 11:38:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 sending to next pipeline
2026-03-30 11:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35b6a7b7-2e19-5823-887d-f5b0c2f64a94, identifier: GA37165
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_2b9a4c1c8b6cded2b74897d5490e1ed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2b9a4c1c8b6cded2b74897d5490e1ed5.jpg not downloaded yet
2026-03-30 11:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 with identifier: GA37165
2026-03-30 11:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 with identifier: GA37165
2026-03-30 11:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35b6a7b7-2e19-5823-887d-f5b0c2f64a94 with identifier: GA37165 to the API
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_47bcb1bead1374390c1123c23068dc6d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:24:15Z',
 'fuel_type': 'diesel',
 'id': '35b6a7b7-2e19-5823-887d-f5b0c2f64a94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA37165',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 201035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_816c752b8dd3723613c6a4db54ff20ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_47bcb1bead1374390c1123c23068dc6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_9e9a0d47dfe00d4b5e60faa202133d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2b05d480eedac473f87d9cf5c53eb6f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_0622838c1a94ec271ecfa519fec8b9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_2c8e711cf80082f92197f7e60b28cdcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_418af090fab13bddd63fcd38285bc914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_4390672bd2dbea1d64204baf1b3d7e45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_95f6c0daa7bb570ff8eba5ba6aa4f806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35b6a7b7-2e19-5823-887d-f5b0c2f64a94/35b6a7b7-2e19-5823-887d-f5b0c2f64a94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/1a/3f1a0426f5e3e328a1122a8456595f21/pa/GA37165_89f3a6a4c0e75403acc6c573d9af0126.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-24',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2',
 'transmission': 'manual',
 'trim': 'L2',
 'year': 2009}
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA37165%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [auto1.be] INFO: Saving data for GA37165: {'created_time': 1774870699.478509, 'last_price_update_time': 1774870699.478522, 'auction_closing_time': 1774970655.0}
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA37165') HTTP/1.1" 204 0
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_3df33df3af98338dc5f449ecbc2ca3ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_3df33df3af98338dc5f449ecbc2ca3ca.jpg not downloaded yet
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD24898> (referer: https://www.auto1.com/v1/car-details-view/XD24898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f40d0>
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_d650197e25bb0baa117deae7ccc861e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_d650197e25bb0baa117deae7ccc861e9.jpg saved to cache
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d0890>
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_113333cc95a7f36c8aa9f677fe60185b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_113333cc95a7f36c8aa9f677fe60185b.jpg saved to cache
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_523cbddcac9803d00022845e118211c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_30b5a975f295e7b4eb3fecb86eee758e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_9a272e640d4edd60cb9ff899111911df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_9a272e640d4edd60cb9ff899111911df.jpg not downloaded yet
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_8c5ff1d5ed12adebdf8e183754fd7254.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_8c5ff1d5ed12adebdf8e183754fd7254.jpg not downloaded yet
2026-03-30 11:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff49d8ff-7493-5f01-881b-80db75270150 with identifier: XD24898
2026-03-30 11:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff49d8ff-7493-5f01-881b-80db75270150 with scrape type 1
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_08b311ca6c4223078c0ce006b00f1a12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08b311ca6c4223078c0ce006b00f1a12.jpg not downloaded yet
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_451f53fac698798dd8b80e9e31bc5ee5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_451f53fac698798dd8b80e9e31bc5ee5.jpg not downloaded yet
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_78a94494e52caafd59c566b4ba5a77a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_78a94494e52caafd59c566b4ba5a77a2.jpg not downloaded yet
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_3df33df3af98338dc5f449ecbc2ca3ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_f0b68e65662ec9e1086da395456801bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_f0b68e65662ec9e1086da395456801bf.jpg not downloaded yet
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_cc6b28d7d0815306826b96e039a2dfea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cc6b28d7d0815306826b96e039a2dfea.jpg not downloaded yet
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e959f5d0>
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_523cbddcac9803d00022845e118211c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_523cbddcac9803d00022845e118211c6.jpg saved to cache
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_89712718f00d3f8e05e97778b1feff5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_89712718f00d3f8e05e97778b1feff5b.jpg not downloaded yet
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e9d50>
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_30b5a975f295e7b4eb3fecb86eee758e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_30b5a975f295e7b4eb3fecb86eee758e.jpg saved to cache
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_78a94494e52caafd59c566b4ba5a77a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_cccdc72a37653ab73bf2228df2f39c0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cccdc72a37653ab73bf2228df2f39c0f.jpg not downloaded yet
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2b9a4c1c8b6cded2b74897d5490e1ed5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98772d0>
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_3df33df3af98338dc5f449ecbc2ca3ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_3df33df3af98338dc5f449ecbc2ca3ca.jpg saved to cache
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_b8a603cdd0f6bc29a532146d4b6337f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_b8a603cdd0f6bc29a532146d4b6337f4.jpg not downloaded yet
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_08e470868b19b93ae01f3aea6f945b8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08e470868b19b93ae01f3aea6f945b8f.jpg not downloaded yet
2026-03-30 11:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cc6b28d7d0815306826b96e039a2dfea.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_735f064703747d12d30110c1954e8fad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_735f064703747d12d30110c1954e8fad.jpg not downloaded yet
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_2d2fd31d1141b5eabd713597f158983e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_2d2fd31d1141b5eabd713597f158983e.jpg not downloaded yet
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1174d0>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_78a94494e52caafd59c566b4ba5a77a2.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_78a94494e52caafd59c566b4ba5a77a2.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b3ad0>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_2b9a4c1c8b6cded2b74897d5490e1ed5.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2b9a4c1c8b6cded2b74897d5490e1ed5.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_89712718f00d3f8e05e97778b1feff5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08e470868b19b93ae01f3aea6f945b8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fd390>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_cc6b28d7d0815306826b96e039a2dfea.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cc6b28d7d0815306826b96e039a2dfea.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_ee487aaaf2c13f4a205ec1031b70940e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_2d2fd31d1141b5eabd713597f158983e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_b8a603cdd0f6bc29a532146d4b6337f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ac1d0>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_89712718f00d3f8e05e97778b1feff5b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_89712718f00d3f8e05e97778b1feff5b.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_735f064703747d12d30110c1954e8fad.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cccdc72a37653ab73bf2228df2f39c0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_f0b68e65662ec9e1086da395456801bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e3c90>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_08e470868b19b93ae01f3aea6f945b8f.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08e470868b19b93ae01f3aea6f945b8f.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea132490>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_ee487aaaf2c13f4a205ec1031b70940e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_ee487aaaf2c13f4a205ec1031b70940e.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_451f53fac698798dd8b80e9e31bc5ee5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_8c5ff1d5ed12adebdf8e183754fd7254.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2ea910>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_2d2fd31d1141b5eabd713597f158983e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_2d2fd31d1141b5eabd713597f158983e.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b9550>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_b8a603cdd0f6bc29a532146d4b6337f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_b8a603cdd0f6bc29a532146d4b6337f4.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08b311ca6c4223078c0ce006b00f1a12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98220d0>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_735f064703747d12d30110c1954e8fad.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_735f064703747d12d30110c1954e8fad.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a9450>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_cccdc72a37653ab73bf2228df2f39c0f.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cccdc72a37653ab73bf2228df2f39c0f.jpg saved to cache
2026-03-30 11:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0f7cd0>
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_f0b68e65662ec9e1086da395456801bf.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_f0b68e65662ec9e1086da395456801bf.jpg saved to cache
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_9a272e640d4edd60cb9ff899111911df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2122d88d2a11d55906c93c6edb37f73b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC22356> (referer: https://www.auto1.com/v1/car-details-view/TC22356/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a1c90>
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_451f53fac698798dd8b80e9e31bc5ee5.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_451f53fac698798dd8b80e9e31bc5ee5.jpg saved to cache
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea117c50>
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_8c5ff1d5ed12adebdf8e183754fd7254.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_8c5ff1d5ed12adebdf8e183754fd7254.jpg saved to cache
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e61d0>
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F23%252Fac234ce87d0b558adf53a64745ac9949%252Fpa%252FXD24898_08b311ca6c4223078c0ce006b00f1a12.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08b311ca6c4223078c0ce006b00f1a12.jpg saved to cache
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff49d8ff-7493-5f01-881b-80db75270150
2026-03-30 11:38:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff49d8ff-7493-5f01-881b-80db75270150, skipping ID generation
2026-03-30 11:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff49d8ff-7493-5f01-881b-80db75270150 with scrape type 1
2026-03-30 11:38:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff49d8ff-7493-5f01-881b-80db75270150 sending to next pipeline
2026-03-30 11:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff49d8ff-7493-5f01-881b-80db75270150, identifier: XD24898
2026-03-30 11:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff49d8ff-7493-5f01-881b-80db75270150 with identifier: XD24898
2026-03-30 11:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff49d8ff-7493-5f01-881b-80db75270150 with identifier: XD24898
2026-03-30 11:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff49d8ff-7493-5f01-881b-80db75270150 with identifier: XD24898 to the API
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08b311ca6c4223078c0ce006b00f1a12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:57:41Z',
 'fuel_type': 'petrol',
 'id': 'ff49d8ff-7493-5f01-881b-80db75270150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD24898',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 130739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08b311ca6c4223078c0ce006b00f1a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_78a94494e52caafd59c566b4ba5a77a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_f0b68e65662ec9e1086da395456801bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cc6b28d7d0815306826b96e039a2dfea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_89712718f00d3f8e05e97778b1feff5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_cccdc72a37653ab73bf2228df2f39c0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_b8a603cdd0f6bc29a532146d4b6337f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_08e470868b19b93ae01f3aea6f945b8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_735f064703747d12d30110c1954e8fad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff49d8ff-7493-5f01-881b-80db75270150/ff49d8ff-7493-5f01-881b-80db75270150_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/23/ac234ce87d0b558adf53a64745ac9949/pa/XD24898_2d2fd31d1141b5eabd713597f158983e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2009}
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD24898%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [auto1.be] INFO: Saving data for XD24898: {'created_time': 1774870705.193115, 'last_price_update_time': 1774870705.193127, 'auction_closing_time': 1774972661.0}
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD24898') HTTP/1.1" 204 0
2026-03-30 11:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_c7941d1109993c57ec69df15d3b64c7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9800590>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_9a272e640d4edd60cb9ff899111911df.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_9a272e640d4edd60cb9ff899111911df.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9732190>
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_2122d88d2a11d55906c93c6edb37f73b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2122d88d2a11d55906c93c6edb37f73b.jpg saved to cache
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e566f9a2-fdd8-5ad1-8565-6557d8aaa92b with identifier: TC22356
2026-03-30 11:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e566f9a2-fdd8-5ad1-8565-6557d8aaa92b with scrape type 1
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e566f9a2-fdd8-5ad1-8565-6557d8aaa92b
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_d3c8023d7e00fc5c5d9ae2230f8bcbc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_d3c8023d7e00fc5c5d9ae2230f8bcbc3.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_7cf7bfc1948cf183be74a9a33377e195.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_7cf7bfc1948cf183be74a9a33377e195.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_6cd96f3720272a7dcb3db5d59553fe66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_6cd96f3720272a7dcb3db5d59553fe66.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_687e87640bdfe4613485e4167b461f45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_687e87640bdfe4613485e4167b461f45.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_cb485ca04fc77349e165bf56b216d88d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_cb485ca04fc77349e165bf56b216d88d.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_da0cf497e2b8253790f6d04f3c4b3ea6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_da0cf497e2b8253790f6d04f3c4b3ea6.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_1937e64da0e3eb8d56354d6922edd4e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_1937e64da0e3eb8d56354d6922edd4e4.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_59b5dc80fded1b18b22b051b10cd468b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_59b5dc80fded1b18b22b051b10cd468b.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_401fea338b36798d6f32958f20257124.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_401fea338b36798d6f32958f20257124.jpg already downloaded
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F35%252Fde35e9f13c0feea228d78733221fa219%252Fpa%252FTC22356_daf9ef3bdb81c7a08d7e8e57fa038b9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_daf9ef3bdb81c7a08d7e8e57fa038b9f.jpg already downloaded
2026-03-30 11:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e566f9a2-fdd8-5ad1-8565-6557d8aaa92b, identifier: TC22356
2026-03-30 11:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e566f9a2-fdd8-5ad1-8565-6557d8aaa92b with identifier: TC22356
2026-03-30 11:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e566f9a2-fdd8-5ad1-8565-6557d8aaa92b with identifier: TC22356
2026-03-30 11:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e566f9a2-fdd8-5ad1-8565-6557d8aaa92b with identifier: TC22356 to the API
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC22356>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:16:50Z',
 'fuel_type': 'petrol',
 'id': 'e566f9a2-fdd8-5ad1-8565-6557d8aaa92b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC22356',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 125960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_d3c8023d7e00fc5c5d9ae2230f8bcbc3.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_7cf7bfc1948cf183be74a9a33377e195.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_6cd96f3720272a7dcb3db5d59553fe66.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_687e87640bdfe4613485e4167b461f45.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_cb485ca04fc77349e165bf56b216d88d.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_da0cf497e2b8253790f6d04f3c4b3ea6.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_1937e64da0e3eb8d56354d6922edd4e4.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_59b5dc80fded1b18b22b051b10cd468b.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_401fea338b36798d6f32958f20257124.jpg',
                'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_daf9ef3bdb81c7a08d7e8e57fa038b9f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3336973,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_d3c8023d7e00fc5c5d9ae2230f8bcbc3.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_7cf7bfc1948cf183be74a9a33377e195.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_6cd96f3720272a7dcb3db5d59553fe66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_687e87640bdfe4613485e4167b461f45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_cb485ca04fc77349e165bf56b216d88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_da0cf497e2b8253790f6d04f3c4b3ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_1937e64da0e3eb8d56354d6922edd4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_59b5dc80fded1b18b22b051b10cd468b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_401fea338b36798d6f32958f20257124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e566f9a2-fdd8-5ad1-8565-6557d8aaa92b/e566f9a2-fdd8-5ad1-8565-6557d8aaa92b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/35/de35e9f13c0feea228d78733221fa219/pa/TC22356_daf9ef3bdb81c7a08d7e8e57fa038b9f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC22356%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.be] INFO: Saving data for TC22356: {'created_time': 1774870706.039889, 'last_price_update_time': 1774870706.039899, 'auction_closing_time': 1774970210.0}
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC22356') HTTP/1.1" 204 0
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_72c7ca1cad762e587deed9cddff51837.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_6bf990c5688862a83299644e1380e1b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e1410>
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F52%252F3a52308e0265c7d19abadd3ee74d5f0d%252Fpa%252FSM25076_c7941d1109993c57ec69df15d3b64c7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_c7941d1109993c57ec69df15d3b64c7b.jpg saved to cache
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8690a729-5ecb-5c68-91cf-ad89c21d3142
2026-03-30 11:38:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8690a729-5ecb-5c68-91cf-ad89c21d3142, skipping ID generation
2026-03-30 11:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8690a729-5ecb-5c68-91cf-ad89c21d3142 with scrape type 1
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8690a729-5ecb-5c68-91cf-ad89c21d3142 sending to next pipeline
2026-03-30 11:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8690a729-5ecb-5c68-91cf-ad89c21d3142, identifier: SM25076
2026-03-30 11:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8690a729-5ecb-5c68-91cf-ad89c21d3142 with identifier: SM25076
2026-03-30 11:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8690a729-5ecb-5c68-91cf-ad89c21d3142 with identifier: SM25076
2026-03-30 11:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8690a729-5ecb-5c68-91cf-ad89c21d3142 with identifier: SM25076 to the API
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_c7941d1109993c57ec69df15d3b64c7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:38:53Z',
 'fuel_type': 'diesel',
 'id': '8690a729-5ecb-5c68-91cf-ad89c21d3142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM25076',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 195176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_c7941d1109993c57ec69df15d3b64c7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2122d88d2a11d55906c93c6edb37f73b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_523cbddcac9803d00022845e118211c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_30b5a975f295e7b4eb3fecb86eee758e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_ee487aaaf2c13f4a205ec1031b70940e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_2b9a4c1c8b6cded2b74897d5490e1ed5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_3df33df3af98338dc5f449ecbc2ca3ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_9a272e640d4edd60cb9ff899111911df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_8c5ff1d5ed12adebdf8e183754fd7254.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8690a729-5ecb-5c68-91cf-ad89c21d3142/8690a729-5ecb-5c68-91cf-ad89c21d3142_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/52/3a52308e0265c7d19abadd3ee74d5f0d/pa/SM25076_451f53fac698798dd8b80e9e31bc5ee5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2005}
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM25076%27 HTTP/1.1" 200 None
2026-03-30 11:38:26 [auto1.be] INFO: Saving data for SM25076: {'created_time': 1774870706.566582, 'last_price_update_time': 1774870706.566592, 'auction_closing_time': 1774971533.0}
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SM25076') HTTP/1.1" 204 0
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_99284397d70895dd864b96dd92c8c475.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_025cd2164a9c5ec533a02d7b02fd8961.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e38d0>
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_72c7ca1cad762e587deed9cddff51837.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_72c7ca1cad762e587deed9cddff51837.jpg saved to cache
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b3410>
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_6bf990c5688862a83299644e1380e1b0.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_6bf990c5688862a83299644e1380e1b0.jpg saved to cache
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9731c10>
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_99284397d70895dd864b96dd92c8c475.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_99284397d70895dd864b96dd92c8c475.jpg saved to cache
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975f110>
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_025cd2164a9c5ec533a02d7b02fd8961.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_025cd2164a9c5ec533a02d7b02fd8961.jpg saved to cache
2026-03-30 11:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0f5b6c60dced0c604f7fd8707d82ee47.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_8f01c32e86f22639efa4fe59d0980eb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d8190>
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_0f5b6c60dced0c604f7fd8707d82ee47.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0f5b6c60dced0c604f7fd8707d82ee47.jpg saved to cache
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e3ad0>
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_8f01c32e86f22639efa4fe59d0980eb1.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_8f01c32e86f22639efa4fe59d0980eb1.jpg saved to cache
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2165d0>
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fbe%252F86bef4098501f046afad9e1d92a7373a%252Fpa%252FWN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg saved to cache
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 322c55e4-28f1-59c5-ad21-1299942c89e9
2026-03-30 11:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 322c55e4-28f1-59c5-ad21-1299942c89e9, skipping ID generation
2026-03-30 11:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322c55e4-28f1-59c5-ad21-1299942c89e9 with scrape type 1
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 322c55e4-28f1-59c5-ad21-1299942c89e9 sending to next pipeline
2026-03-30 11:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 322c55e4-28f1-59c5-ad21-1299942c89e9, identifier: WN16756
2026-03-30 11:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 322c55e4-28f1-59c5-ad21-1299942c89e9 with identifier: WN16756
2026-03-30 11:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 322c55e4-28f1-59c5-ad21-1299942c89e9 with identifier: WN16756
2026-03-30 11:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 322c55e4-28f1-59c5-ad21-1299942c89e9 with identifier: WN16756 to the API
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:36:36Z',
 'fuel_type': 'petrol',
 'id': '322c55e4-28f1-59c5-ad21-1299942c89e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN16756',
 'listing': 'auction',
 'location': 'BE, Brugge',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 86072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_99284397d70895dd864b96dd92c8c475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_025cd2164a9c5ec533a02d7b02fd8961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_2b65f820e655dd17e1f068a2abb2c692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_e45c06db1f0a29a7a2519e5f51f03c52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_72c7ca1cad762e587deed9cddff51837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_6bf990c5688862a83299644e1380e1b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_113333cc95a7f36c8aa9f677fe60185b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_996c96131593efb5f5033ff5d91089f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_d650197e25bb0baa117deae7ccc861e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_322c55e4-28f1-59c5-ad21-1299942c89e9/322c55e4-28f1-59c5-ad21-1299942c89e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/be/86bef4098501f046afad9e1d92a7373a/pa/WN16756_dbfbf67d4ee82399a3ba5270f21249b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN16756%27 HTTP/1.1" 200 None
2026-03-30 11:38:27 [auto1.be] INFO: Saving data for WN16756: {'created_time': 1774870707.523686, 'last_price_update_time': 1774870707.523695, 'auction_closing_time': 1774971396.0}
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN16756') HTTP/1.1" 204 0
2026-03-30 11:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_4248ff05796081d2e71e8b8ea1bf132b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:27 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1756 | hits on page: 40
2026-03-30 11:38:27 [auto1.be] INFO: Found listing with ID: FX96878
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FX96878%27 HTTP/1.1" 200 None
2026-03-30 11:38:27 [auto1.be] INFO: Scrape type for FX96878: 0
2026-03-30 11:38:27 [auto1.be] INFO: Found listing with ID: AP57760
2026-03-30 11:38:27 [auto1.be] INFO: Found listing with ID: KX38025
2026-03-30 11:38:27 [auto1.be] INFO: Found listing with ID: UY15914
2026-03-30 11:38:27 [auto1.be] INFO: Found listing with ID: MD90216
2026-03-30 11:38:27 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-30 11:38:27 [auto1.be] INFO: Scrape type for LJ80656: 2
2026-03-30 11:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656
2026-03-30 11:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21fbe423-c72b-5442-96a0-b006f4f7260d with scrape type 2
2026-03-30 11:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21fbe423-c72b-5442-96a0-b006f4f7260d with scrape type 2
2026-03-30 11:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21fbe423-c72b-5442-96a0-b006f4f7260d, identifier: LJ80656
2026-03-30 11:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656
2026-03-30 11:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656
2026-03-30 11:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21fbe423-c72b-5442-96a0-b006f4f7260d with identifier: LJ80656 to the API
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:31:09Z',
 'fuel_type': 'petrol',
 'id': '21fbe423-c72b-5442-96a0-b006f4f7260d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ80656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 208635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Saving data for LJ80656: {'auction_closing_time': 1774971069.0, 'created_time': 1773134362.730398, 'last_price_update_time': 1774870708.088269}
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ80656') HTTP/1.1" 204 0
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: XZ36131
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: TW96115
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW96115%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Scrape type for TW96115: 1
2026-03-30 11:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW30540> (referer: https://www.auto1.com/v1/car-details-view/SW30540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d3f90>
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_4248ff05796081d2e71e8b8ea1bf132b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_4248ff05796081d2e71e8b8ea1bf132b.jpg saved to cache
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: XP64543
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP64543%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Scrape type for XP64543: 1
2026-03-30 11:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Scrape type for RZ67143: 2
2026-03-30 11:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143
2026-03-30 11:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3845ba47-1b81-5137-99c9-0db27fcae5e1 with scrape type 2
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3845ba47-1b81-5137-99c9-0db27fcae5e1 with scrape type 2
2026-03-30 11:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3845ba47-1b81-5137-99c9-0db27fcae5e1, identifier: RZ67143
2026-03-30 11:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143
2026-03-30 11:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143
2026-03-30 11:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3845ba47-1b81-5137-99c9-0db27fcae5e1 with identifier: RZ67143 to the API
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:37:24Z',
 'fuel_type': 'petrol',
 'id': '3845ba47-1b81-5137-99c9-0db27fcae5e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ67143',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 70584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Saving data for RZ67143: {'auction_closing_time': 1774971444.0, 'created_time': 1773301661.376532, 'last_price_update_time': 1774870708.73237}
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ67143') HTTP/1.1" 204 0
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: FK03053
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK03053%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Scrape type for FK03053: 1
2026-03-30 11:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb4a999-4bc6-505a-802e-cde6789179b3 with identifier: SW30540
2026-03-30 11:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb4a999-4bc6-505a-802e-cde6789179b3 with scrape type 1
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg not downloaded yet
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: AC52442
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: KT25789
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: UZ91497
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: VA10868
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: UP32209
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: SL82262
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: YK50481
2026-03-30 11:38:28 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [auto1.be] INFO: Scrape type for TX71438: 2
2026-03-30 11:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438
2026-03-30 11:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129500a7-4834-5f7e-a9ab-6617061c69c7 with scrape type 2
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129500a7-4834-5f7e-a9ab-6617061c69c7 with scrape type 2
2026-03-30 11:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 129500a7-4834-5f7e-a9ab-6617061c69c7, identifier: TX71438
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_6e5591313c05c8dd3a941a894e9c3367.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_6e5591313c05c8dd3a941a894e9c3367.jpg not downloaded yet
2026-03-30 11:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438
2026-03-30 11:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438
2026-03-30 11:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 129500a7-4834-5f7e-a9ab-6617061c69c7 with identifier: TX71438 to the API
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:15:01Z',
 'fuel_type': 'diesel',
 'id': '129500a7-4834-5f7e-a9ab-6617061c69c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX71438',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 111968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-07',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Saving data for TX71438: {'auction_closing_time': 1774970101.0, 'created_time': 1773348935.116575, 'last_price_update_time': 1774870709.263931}
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX71438') HTTP/1.1" 204 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: VV61440
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV61440%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for VV61440: 1
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_8742798c1104ec5218f94bd782d07fee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_8742798c1104ec5218f94bd782d07fee.jpg not downloaded yet
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: SX17712
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: DD41126
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: HL85042
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: WR16749
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: DJ32328
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ32328%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for DJ32328: 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: NS39608
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: FE21102
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE21102%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for FE21102: 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: KP84190
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP84190%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for KP84190: 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: JM82997
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: EH30324
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: ME19194
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for CW36552: 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: XM81929
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: RL35333
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: WD23717
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD23717%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for WD23717: 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [auto1.be] INFO: Scrape type for XH74025: 0
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-30 11:38:29 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_4946d91f7a61f776b79f8a948f144c3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_4946d91f7a61f776b79f8a948f144c3e.jpg not downloaded yet
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_1a8944fb638c00b6a6c4aca6f983d4e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_1a8944fb638c00b6a6c4aca6f983d4e2.jpg not downloaded yet
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_a930deda138d39d8a402e98961f018df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_a930deda138d39d8a402e98961f018df.jpg not downloaded yet
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_d1e430ce0aa5d54bab7514bbf9198d5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_d1e430ce0aa5d54bab7514bbf9198d5a.jpg not downloaded yet
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_215047bd801524c36eb051d359264d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_215047bd801524c36eb051d359264d1a.jpg not downloaded yet
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_572d6bb5069e9d4e973b2ae5a7ac3f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_572d6bb5069e9d4e973b2ae5a7ac3f3a.jpg not downloaded yet
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_90d34fb52229f9a190d1fa75420c5963.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_90d34fb52229f9a190d1fa75420c5963.jpg not downloaded yet
2026-03-30 11:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_98943e7a0151094173699f61f6dcbbed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_90d34fb52229f9a190d1fa75420c5963.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a8d50>
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_98943e7a0151094173699f61f6dcbbed.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_98943e7a0151094173699f61f6dcbbed.jpg saved to cache
2026-03-30 11:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_572d6bb5069e9d4e973b2ae5a7ac3f3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e0ed0>
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_90d34fb52229f9a190d1fa75420c5963.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_90d34fb52229f9a190d1fa75420c5963.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9801e50>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_572d6bb5069e9d4e973b2ae5a7ac3f3a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_572d6bb5069e9d4e973b2ae5a7ac3f3a.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_215047bd801524c36eb051d359264d1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_d1e430ce0aa5d54bab7514bbf9198d5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0da910>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_215047bd801524c36eb051d359264d1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_215047bd801524c36eb051d359264d1a.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_a930deda138d39d8a402e98961f018df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96aa5d0>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_d1e430ce0aa5d54bab7514bbf9198d5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_d1e430ce0aa5d54bab7514bbf9198d5a.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_1a8944fb638c00b6a6c4aca6f983d4e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e0110>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_a930deda138d39d8a402e98961f018df.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_a930deda138d39d8a402e98961f018df.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_4946d91f7a61f776b79f8a948f144c3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e6890>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_1a8944fb638c00b6a6c4aca6f983d4e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_1a8944fb638c00b6a6c4aca6f983d4e2.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_8742798c1104ec5218f94bd782d07fee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e1110>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_4946d91f7a61f776b79f8a948f144c3e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_4946d91f7a61f776b79f8a948f144c3e.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a8c50>
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_8742798c1104ec5218f94bd782d07fee.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_8742798c1104ec5218f94bd782d07fee.jpg saved to cache
2026-03-30 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK78236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_6e5591313c05c8dd3a941a894e9c3367.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a7310>
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_6e5591313c05c8dd3a941a894e9c3367.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_6e5591313c05c8dd3a941a894e9c3367.jpg saved to cache
2026-03-30 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a6c50>
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F5b%252Fbd5bf549da8e134d11270a235baabdf9%252Fpa%252FSW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg saved to cache
2026-03-30 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eeb4a999-4bc6-505a-802e-cde6789179b3
2026-03-30 11:38:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eeb4a999-4bc6-505a-802e-cde6789179b3, skipping ID generation
2026-03-30 11:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb4a999-4bc6-505a-802e-cde6789179b3 with scrape type 1
2026-03-30 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eeb4a999-4bc6-505a-802e-cde6789179b3 sending to next pipeline
2026-03-30 11:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eeb4a999-4bc6-505a-802e-cde6789179b3, identifier: SW30540
2026-03-30 11:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eeb4a999-4bc6-505a-802e-cde6789179b3 with identifier: SW30540
2026-03-30 11:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eeb4a999-4bc6-505a-802e-cde6789179b3 with identifier: SW30540
2026-03-30 11:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eeb4a999-4bc6-505a-802e-cde6789179b3 with identifier: SW30540 to the API
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:39:54Z',
 'fuel_type': 'petrol',
 'id': 'eeb4a999-4bc6-505a-802e-cde6789179b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW30540',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 142076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_e67b79ee3bc7262ada1e89e596c296b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_6e5591313c05c8dd3a941a894e9c3367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_8742798c1104ec5218f94bd782d07fee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_4946d91f7a61f776b79f8a948f144c3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_1a8944fb638c00b6a6c4aca6f983d4e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_a930deda138d39d8a402e98961f018df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_d1e430ce0aa5d54bab7514bbf9198d5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_215047bd801524c36eb051d359264d1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_572d6bb5069e9d4e973b2ae5a7ac3f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb4a999-4bc6-505a-802e-cde6789179b3/eeb4a999-4bc6-505a-802e-cde6789179b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/5b/bd5bf549da8e134d11270a235baabdf9/pa/SW30540_90d34fb52229f9a190d1fa75420c5963.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Connection',
 'transmission': 'manual',
 'trim': 'Connection',
 'year': 2008}
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW30540%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [auto1.be] INFO: Saving data for SW30540: {'created_time': 1774870712.382072, 'last_price_update_time': 1774870712.382084, 'auction_closing_time': 1774971594.0}
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW30540') HTTP/1.1" 204 0
2026-03-30 11:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES37809> (referer: https://www.auto1.com/v1/car-details-view/ES37809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45d42526-7871-5820-98d9-ef6310bc66c3 with identifier: ES37809
2026-03-30 11:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45d42526-7871-5820-98d9-ef6310bc66c3 with scrape type 1
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_7e961292cda6a8834ce1688f007c489e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_7e961292cda6a8834ce1688f007c489e.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_ef35bfda8423718ae334598b1ff0b37b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_ef35bfda8423718ae334598b1ff0b37b.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_d7bd2b7fbcc499dc1aabb2fa8534479c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_d7bd2b7fbcc499dc1aabb2fa8534479c.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_721cf38cdbe66e0fd4cc76cb13e00e46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_721cf38cdbe66e0fd4cc76cb13e00e46.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_5bd07f9c30edc9c91bb083314c6530e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_5bd07f9c30edc9c91bb083314c6530e5.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_df520bbd0718dbd68934fd9325522984.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_df520bbd0718dbd68934fd9325522984.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_9a592f381fbaabf3c7da6cc682562351.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_9a592f381fbaabf3c7da6cc682562351.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_11b00b4ed4886762cfb2e6f7a3c07739.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_11b00b4ed4886762cfb2e6f7a3c07739.jpg not downloaded yet
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_089548ff392d886de2bc9bd1e5ce88d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_089548ff392d886de2bc9bd1e5ce88d2.jpg not downloaded yet
2026-03-30 11:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY10486> (referer: https://www.auto1.com/v1/car-details-view/EY10486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_089548ff392d886de2bc9bd1e5ce88d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fec25000-9b55-51c8-96c9-687398dd95a5 with identifier: EY10486
2026-03-30 11:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fec25000-9b55-51c8-96c9-687398dd95a5 with scrape type 1
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fec25000-9b55-51c8-96c9-687398dd95a5
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_297eeb60680dd8ae7a71316ec4f01e64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_297eeb60680dd8ae7a71316ec4f01e64.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_74ffe82f88d36317736dcf160d81e87c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_74ffe82f88d36317736dcf160d81e87c.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_61123971c3a79bd11f5c6ac519cc85ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_61123971c3a79bd11f5c6ac519cc85ad.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_6c5377329d9e8b9e9f51f3f41236a2cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_6c5377329d9e8b9e9f51f3f41236a2cd.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_3f138beb3f132f49df09218b765040c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_3f138beb3f132f49df09218b765040c4.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_0e28266259a031f99915737358627e14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_0e28266259a031f99915737358627e14.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_b8a7761a86f7f826946880145440877b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_b8a7761a86f7f826946880145440877b.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_0b071226bdab813c3fd5d230533a9eb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_0b071226bdab813c3fd5d230533a9eb4.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_620c43fbe3584fef1f081ff0feafc688.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_620c43fbe3584fef1f081ff0feafc688.jpg already downloaded
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fcb%252F54cb6f12ddab1a16536272818b99f415%252Fpa%252FEY10486_4d311647575d11b1b57fff3cdd2d632d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_4d311647575d11b1b57fff3cdd2d632d.jpg already downloaded
2026-03-30 11:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fec25000-9b55-51c8-96c9-687398dd95a5, identifier: EY10486
2026-03-30 11:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fec25000-9b55-51c8-96c9-687398dd95a5 with identifier: EY10486
2026-03-30 11:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fec25000-9b55-51c8-96c9-687398dd95a5 with identifier: EY10486
2026-03-30 11:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fec25000-9b55-51c8-96c9-687398dd95a5 with identifier: EY10486 to the API
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY10486>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:54:40Z',
 'fuel_type': 'diesel',
 'id': 'fec25000-9b55-51c8-96c9-687398dd95a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY10486',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 135511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_297eeb60680dd8ae7a71316ec4f01e64.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_74ffe82f88d36317736dcf160d81e87c.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_61123971c3a79bd11f5c6ac519cc85ad.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_6c5377329d9e8b9e9f51f3f41236a2cd.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_3f138beb3f132f49df09218b765040c4.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_0e28266259a031f99915737358627e14.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_b8a7761a86f7f826946880145440877b.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_0b071226bdab813c3fd5d230533a9eb4.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_620c43fbe3584fef1f081ff0feafc688.jpg',
                'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_4d311647575d11b1b57fff3cdd2d632d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_297eeb60680dd8ae7a71316ec4f01e64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2467825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_74ffe82f88d36317736dcf160d81e87c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_61123971c3a79bd11f5c6ac519cc85ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_6c5377329d9e8b9e9f51f3f41236a2cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2196231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_3f138beb3f132f49df09218b765040c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_0e28266259a031f99915737358627e14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_b8a7761a86f7f826946880145440877b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_0b071226bdab813c3fd5d230533a9eb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_620c43fbe3584fef1f081ff0feafc688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fec25000-9b55-51c8-96c9-687398dd95a5/fec25000-9b55-51c8-96c9-687398dd95a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/cb/54cb6f12ddab1a16536272818b99f415/pa/EY10486_4d311647575d11b1b57fff3cdd2d632d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2014}
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY10486%27 HTTP/1.1" 200 None
2026-03-30 11:38:34 [auto1.be] INFO: Saving data for EY10486: {'created_time': 1774870714.30505, 'last_price_update_time': 1774870714.305061, 'auction_closing_time': 1774972480.0}
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY10486') HTTP/1.1" 204 0
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_11b00b4ed4886762cfb2e6f7a3c07739.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2f6450>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_089548ff392d886de2bc9bd1e5ce88d2.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_089548ff392d886de2bc9bd1e5ce88d2.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaeb9590>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_11b00b4ed4886762cfb2e6f7a3c07739.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_11b00b4ed4886762cfb2e6f7a3c07739.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_9a592f381fbaabf3c7da6cc682562351.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_df520bbd0718dbd68934fd9325522984.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9852110>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_9a592f381fbaabf3c7da6cc682562351.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_9a592f381fbaabf3c7da6cc682562351.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_5bd07f9c30edc9c91bb083314c6530e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea214890>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_df520bbd0718dbd68934fd9325522984.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_df520bbd0718dbd68934fd9325522984.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_721cf38cdbe66e0fd4cc76cb13e00e46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22f990>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_5bd07f9c30edc9c91bb083314c6530e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_5bd07f9c30edc9c91bb083314c6530e5.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_d7bd2b7fbcc499dc1aabb2fa8534479c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9887710>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_721cf38cdbe66e0fd4cc76cb13e00e46.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_721cf38cdbe66e0fd4cc76cb13e00e46.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_ef35bfda8423718ae334598b1ff0b37b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea207790>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_d7bd2b7fbcc499dc1aabb2fa8534479c.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_d7bd2b7fbcc499dc1aabb2fa8534479c.jpg saved to cache
2026-03-30 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_7e961292cda6a8834ce1688f007c489e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975aa90>
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_ef35bfda8423718ae334598b1ff0b37b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_ef35bfda8423718ae334598b1ff0b37b.jpg saved to cache
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e2790>
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_7e961292cda6a8834ce1688f007c489e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_7e961292cda6a8834ce1688f007c489e.jpg saved to cache
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea191050>
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fca%252F75ca0bad43f089d7ae0bdc04594c2dd2%252Fpa%252FES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg saved to cache
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45d42526-7871-5820-98d9-ef6310bc66c3
2026-03-30 11:38:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45d42526-7871-5820-98d9-ef6310bc66c3, skipping ID generation
2026-03-30 11:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45d42526-7871-5820-98d9-ef6310bc66c3 with scrape type 1
2026-03-30 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45d42526-7871-5820-98d9-ef6310bc66c3 sending to next pipeline
2026-03-30 11:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45d42526-7871-5820-98d9-ef6310bc66c3, identifier: ES37809
2026-03-30 11:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45d42526-7871-5820-98d9-ef6310bc66c3 with identifier: ES37809
2026-03-30 11:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45d42526-7871-5820-98d9-ef6310bc66c3 with identifier: ES37809
2026-03-30 11:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45d42526-7871-5820-98d9-ef6310bc66c3 with identifier: ES37809 to the API
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:51:45Z',
 'fuel_type': 'petrol',
 'id': '45d42526-7871-5820-98d9-ef6310bc66c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES37809',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 140021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_2e14e8b23bf7fd4f9315dce30fcca550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_7e961292cda6a8834ce1688f007c489e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_ef35bfda8423718ae334598b1ff0b37b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_d7bd2b7fbcc499dc1aabb2fa8534479c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_721cf38cdbe66e0fd4cc76cb13e00e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_5bd07f9c30edc9c91bb083314c6530e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_df520bbd0718dbd68934fd9325522984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_9a592f381fbaabf3c7da6cc682562351.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_11b00b4ed4886762cfb2e6f7a3c07739.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45d42526-7871-5820-98d9-ef6310bc66c3/45d42526-7871-5820-98d9-ef6310bc66c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/ca/75ca0bad43f089d7ae0bdc04594c2dd2/pa/ES37809_089548ff392d886de2bc9bd1e5ce88d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Grand Filou Cool',
 'transmission': 'manual',
 'trim': 'Grand Filou Cool',
 'year': 2006}
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES37809%27 HTTP/1.1" 200 None
2026-03-30 11:38:35 [auto1.be] INFO: Saving data for ES37809: {'created_time': 1774870715.997762, 'last_price_update_time': 1774870715.997774, 'auction_closing_time': 1774972305.0}
2026-03-30 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES37809') HTTP/1.1" 204 0
2026-03-30 11:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN89507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL22042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH36380> (referer: https://www.auto1.com/v1/car-details-view/ZH36380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0a11342-34cd-5f16-80ce-70edda9effc1 with identifier: ZH36380
2026-03-30 11:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0a11342-34cd-5f16-80ce-70edda9effc1 with scrape type 1
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_74d27fd502a0e91181ba19c0b8bb5407.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_74d27fd502a0e91181ba19c0b8bb5407.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_4e7e83498711c7e2bc22e6cd27647a6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_4e7e83498711c7e2bc22e6cd27647a6f.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_553b6849be901abe08a56550ba5c2de9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_553b6849be901abe08a56550ba5c2de9.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_5942e194a707c041511491780fdc6d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_5942e194a707c041511491780fdc6d48.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_b2c85391e1d53736e6aa21c1790c5753.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_b2c85391e1d53736e6aa21c1790c5753.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_e31d80ee23e6a8ed32437d214d0cf79b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_e31d80ee23e6a8ed32437d214d0cf79b.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_624a9f375a51aad6d4aef773365a6ff8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_624a9f375a51aad6d4aef773365a6ff8.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_98bc72b94272886f4690de1fecc88049.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_98bc72b94272886f4690de1fecc88049.jpg not downloaded yet
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_688289a83636d98e2ec194f38ba17c9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_688289a83636d98e2ec194f38ba17c9f.jpg not downloaded yet
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY31079> (referer: https://www.auto1.com/v1/car-details-view/SY31079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d98dd41a-a105-57c7-a129-51c3f155f884 with identifier: SY31079
2026-03-30 11:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d98dd41a-a105-57c7-a129-51c3f155f884 with scrape type 1
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_504611c6cb8030c404279a3b8c69d30e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_504611c6cb8030c404279a3b8c69d30e.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_6588598a24287fd18edb8fd2af001d08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_6588598a24287fd18edb8fd2af001d08.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_0c6d370001191f94db6bee12b72e9ee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_0c6d370001191f94db6bee12b72e9ee3.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_cd5eac709567f1eac682e7a14e6a2c5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_cd5eac709567f1eac682e7a14e6a2c5d.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_006c999f947e6bc6694cd51a3aa5a97a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_006c999f947e6bc6694cd51a3aa5a97a.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_22a525a79bacdbc5a541d63f468340ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_22a525a79bacdbc5a541d63f468340ba.jpg not downloaded yet
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_688289a83636d98e2ec194f38ba17c9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_06cdbe8be8265c24a18fc27bc6ba2ef4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_06cdbe8be8265c24a18fc27bc6ba2ef4.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_234e55fa50c022711795134832f7f0c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_234e55fa50c022711795134832f7f0c0.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_4202fa6d3c9deb72fdfc3489a5db2572.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_4202fa6d3c9deb72fdfc3489a5db2572.jpg not downloaded yet
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_46c2ae941979f0ac62b1b7f70a575f48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_46c2ae941979f0ac62b1b7f70a575f48.jpg not downloaded yet
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d96d0>
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_688289a83636d98e2ec194f38ba17c9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_688289a83636d98e2ec194f38ba17c9f.jpg saved to cache
2026-03-30 11:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_22a525a79bacdbc5a541d63f468340ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_46c2ae941979f0ac62b1b7f70a575f48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a70d0>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_22a525a79bacdbc5a541d63f468340ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_22a525a79bacdbc5a541d63f468340ba.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_4202fa6d3c9deb72fdfc3489a5db2572.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9887b90>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_46c2ae941979f0ac62b1b7f70a575f48.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_46c2ae941979f0ac62b1b7f70a575f48.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_234e55fa50c022711795134832f7f0c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9885f10>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_4202fa6d3c9deb72fdfc3489a5db2572.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_4202fa6d3c9deb72fdfc3489a5db2572.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN07894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_06cdbe8be8265c24a18fc27bc6ba2ef4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a4390>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_234e55fa50c022711795134832f7f0c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_234e55fa50c022711795134832f7f0c0.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_006c999f947e6bc6694cd51a3aa5a97a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_cd5eac709567f1eac682e7a14e6a2c5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea25bd90>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_06cdbe8be8265c24a18fc27bc6ba2ef4.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_06cdbe8be8265c24a18fc27bc6ba2ef4.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_6588598a24287fd18edb8fd2af001d08.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_0c6d370001191f94db6bee12b72e9ee3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a7ed0>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_006c999f947e6bc6694cd51a3aa5a97a.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_006c999f947e6bc6694cd51a3aa5a97a.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a5c50>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_cd5eac709567f1eac682e7a14e6a2c5d.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_cd5eac709567f1eac682e7a14e6a2c5d.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_504611c6cb8030c404279a3b8c69d30e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9740bd0>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_6588598a24287fd18edb8fd2af001d08.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_6588598a24287fd18edb8fd2af001d08.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12dd50>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_0c6d370001191f94db6bee12b72e9ee3.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_0c6d370001191f94db6bee12b72e9ee3.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96db110>
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F20%252Fcc20df8d7e0f97d2fe36239e43543635%252Fpa%252FSY31079_504611c6cb8030c404279a3b8c69d30e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_504611c6cb8030c404279a3b8c69d30e.jpg saved to cache
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d98dd41a-a105-57c7-a129-51c3f155f884
2026-03-30 11:38:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d98dd41a-a105-57c7-a129-51c3f155f884, skipping ID generation
2026-03-30 11:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d98dd41a-a105-57c7-a129-51c3f155f884 with scrape type 1
2026-03-30 11:38:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d98dd41a-a105-57c7-a129-51c3f155f884 sending to next pipeline
2026-03-30 11:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d98dd41a-a105-57c7-a129-51c3f155f884, identifier: SY31079
2026-03-30 11:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d98dd41a-a105-57c7-a129-51c3f155f884 with identifier: SY31079
2026-03-30 11:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d98dd41a-a105-57c7-a129-51c3f155f884 with identifier: SY31079
2026-03-30 11:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d98dd41a-a105-57c7-a129-51c3f155f884 with identifier: SY31079 to the API
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_504611c6cb8030c404279a3b8c69d30e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:35:00Z',
 'fuel_type': 'petrol',
 'id': 'd98dd41a-a105-57c7-a129-51c3f155f884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY31079',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 182038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_504611c6cb8030c404279a3b8c69d30e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_6588598a24287fd18edb8fd2af001d08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_0c6d370001191f94db6bee12b72e9ee3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_cd5eac709567f1eac682e7a14e6a2c5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_006c999f947e6bc6694cd51a3aa5a97a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_22a525a79bacdbc5a541d63f468340ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_06cdbe8be8265c24a18fc27bc6ba2ef4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_234e55fa50c022711795134832f7f0c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_4202fa6d3c9deb72fdfc3489a5db2572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d98dd41a-a105-57c7-a129-51c3f155f884/d98dd41a-a105-57c7-a129-51c3f155f884_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/20/cc20df8d7e0f97d2fe36239e43543635/pa/SY31079_46c2ae941979f0ac62b1b7f70a575f48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY31079%27 HTTP/1.1" 200 None
2026-03-30 11:38:42 [auto1.be] INFO: Saving data for SY31079: {'created_time': 1774870722.283145, 'last_price_update_time': 1774870722.283155, 'auction_closing_time': 1774971300.0}
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY31079') HTTP/1.1" 204 0
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV61440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_98bc72b94272886f4690de1fecc88049.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f4190>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_98bc72b94272886f4690de1fecc88049.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_98bc72b94272886f4690de1fecc88049.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_e31d80ee23e6a8ed32437d214d0cf79b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_624a9f375a51aad6d4aef773365a6ff8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9884510>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_e31d80ee23e6a8ed32437d214d0cf79b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_e31d80ee23e6a8ed32437d214d0cf79b.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f5490>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_624a9f375a51aad6d4aef773365a6ff8.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_624a9f375a51aad6d4aef773365a6ff8.jpg saved to cache
2026-03-30 11:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_b2c85391e1d53736e6aa21c1790c5753.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c2c90>
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_b2c85391e1d53736e6aa21c1790c5753.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_b2c85391e1d53736e6aa21c1790c5753.jpg saved to cache
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_5942e194a707c041511491780fdc6d48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e1dd0>
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_5942e194a707c041511491780fdc6d48.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_5942e194a707c041511491780fdc6d48.jpg saved to cache
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_553b6849be901abe08a56550ba5c2de9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e976d810>
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_553b6849be901abe08a56550ba5c2de9.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_553b6849be901abe08a56550ba5c2de9.jpg saved to cache
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_4e7e83498711c7e2bc22e6cd27647a6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaeb9310>
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_4e7e83498711c7e2bc22e6cd27647a6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_4e7e83498711c7e2bc22e6cd27647a6f.jpg saved to cache
2026-03-30 11:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_74d27fd502a0e91181ba19c0b8bb5407.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975d8d0>
2026-03-30 11:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_74d27fd502a0e91181ba19c0b8bb5407.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_74d27fd502a0e91181ba19c0b8bb5407.jpg saved to cache
2026-03-30 11:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.959(s), this was the 1st time calling it.
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.624507491605936 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.737(s), this was the 2nd time calling it.
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.033954652781766 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c2b50>
2026-03-30 11:38:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfdf98c041374b2a6b96aa97e43bdda%252Fpa%252FZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg saved to cache
2026-03-30 11:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0a11342-34cd-5f16-80ce-70edda9effc1
2026-03-30 11:38:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0a11342-34cd-5f16-80ce-70edda9effc1, skipping ID generation
2026-03-30 11:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0a11342-34cd-5f16-80ce-70edda9effc1 with scrape type 1
2026-03-30 11:38:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0a11342-34cd-5f16-80ce-70edda9effc1 sending to next pipeline
2026-03-30 11:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0a11342-34cd-5f16-80ce-70edda9effc1, identifier: ZH36380
2026-03-30 11:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0a11342-34cd-5f16-80ce-70edda9effc1 with identifier: ZH36380
2026-03-30 11:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0a11342-34cd-5f16-80ce-70edda9effc1 with identifier: ZH36380
2026-03-30 11:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0a11342-34cd-5f16-80ce-70edda9effc1 with identifier: ZH36380 to the API
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:26:35Z',
 'fuel_type': 'diesel',
 'id': 'e0a11342-34cd-5f16-80ce-70edda9effc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH36380',
 'listing': 'auction',
 'location': 'BE, Kapellen',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 126729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3606634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_bb74fe557f1190e5ceff3cc04386c0e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3551043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_74d27fd502a0e91181ba19c0b8bb5407.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_4e7e83498711c7e2bc22e6cd27647a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_553b6849be901abe08a56550ba5c2de9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3094718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_5942e194a707c041511491780fdc6d48.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2943740,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_b2c85391e1d53736e6aa21c1790c5753.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_e31d80ee23e6a8ed32437d214d0cf79b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_624a9f375a51aad6d4aef773365a6ff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3233576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_98bc72b94272886f4690de1fecc88049.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0a11342-34cd-5f16-80ce-70edda9effc1/e0a11342-34cd-5f16-80ce-70edda9effc1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfdf98c041374b2a6b96aa97e43bdda/pa/ZH36380_688289a83636d98e2ec194f38ba17c9f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Style',
 'transmission': 'automatic',
 'trim': '4Matic Style',
 'year': 2015}
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH36380%27 HTTP/1.1" 200 None
2026-03-30 11:38:44 [auto1.be] INFO: Saving data for ZH36380: {'created_time': 1774870724.94999, 'last_price_update_time': 1774870724.949997, 'auction_closing_time': 1774970795.0}
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH36380') HTTP/1.1" 204 0
2026-03-30 11:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_330aef6f43d07bdb42cbfc9359759f5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a0290>
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_330aef6f43d07bdb42cbfc9359759f5e.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_330aef6f43d07bdb42cbfc9359759f5e.jpg saved to cache
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_3db5d49331d356e82492cac2d3906a77.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e3c90>
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_3db5d49331d356e82492cac2d3906a77.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_3db5d49331d356e82492cac2d3906a77.jpg saved to cache
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_5adcb18c0c1423199996231f9a728a0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:38:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d9cd0>
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F6f%252F5d6f3b8399cd49fca22c943c3aebb4a3%252Fpa%252FTU92557_5adcb18c0c1423199996231f9a728a0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_5adcb18c0c1423199996231f9a728a0b.jpg saved to cache
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53db3876-5e15-5b3f-8263-36167aa7afb0
2026-03-30 11:38:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53db3876-5e15-5b3f-8263-36167aa7afb0, skipping ID generation
2026-03-30 11:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53db3876-5e15-5b3f-8263-36167aa7afb0 with scrape type 1
2026-03-30 11:38:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53db3876-5e15-5b3f-8263-36167aa7afb0 sending to next pipeline
2026-03-30 11:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53db3876-5e15-5b3f-8263-36167aa7afb0, identifier: TU92557
2026-03-30 11:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53db3876-5e15-5b3f-8263-36167aa7afb0 with identifier: TU92557
2026-03-30 11:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53db3876-5e15-5b3f-8263-36167aa7afb0 with identifier: TU92557
2026-03-30 11:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53db3876-5e15-5b3f-8263-36167aa7afb0 with identifier: TU92557 to the API
2026-03-30 11:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_5adcb18c0c1423199996231f9a728a0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:36:34Z',
 'fuel_type': 'petrol',
 'id': '53db3876-5e15-5b3f-8263-36167aa7afb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU92557',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 95491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2747719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_5adcb18c0c1423199996231f9a728a0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_3db5d49331d356e82492cac2d3906a77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_330aef6f43d07bdb42cbfc9359759f5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_98943e7a0151094173699f61f6dcbbed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549520,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_4248ff05796081d2e71e8b8ea1bf132b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_8f01c32e86f22639efa4fe59d0980eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0f5b6c60dced0c604f7fd8707d82ee47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_01f7d72c856b1e7ed7424d61b9b33562.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_0cf89682f13f5acfdf1f8ec94bbc417e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53db3876-5e15-5b3f-8263-36167aa7afb0/53db3876-5e15-5b3f-8263-36167aa7afb0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/6f/5d6f3b8399cd49fca22c943c3aebb4a3/pa/TU92557_33eaa0471d9b22a682786225f57cb38c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Collection',
 'transmission': 'automatic',
 'trim': 'Collection',
 'year': 2018}
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU92557%27 HTTP/1.1" 200 None
2026-03-30 11:38:46 [auto1.be] INFO: Saving data for TU92557: {'created_time': 1774870726.944592, 'last_price_update_time': 1774870726.944604, 'auction_closing_time': 1774971394.0}
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU92557') HTTP/1.1" 204 0
2026-03-30 11:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK78236> (referer: https://www.auto1.com/v1/car-details-view/EK78236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555d2526-9b4f-5ec2-a0c4-67aa442d44b2 with identifier: EK78236
2026-03-30 11:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555d2526-9b4f-5ec2-a0c4-67aa442d44b2 with scrape type 1
2026-03-30 11:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 555d2526-9b4f-5ec2-a0c4-67aa442d44b2
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_edbbf6e94331207e901c3945be92be00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_edbbf6e94331207e901c3945be92be00.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_4702c4609e4960a8b8eed6d6af12f000.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_4702c4609e4960a8b8eed6d6af12f000.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_872935eb4a2d581cd6d8cb50f7ab86a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_872935eb4a2d581cd6d8cb50f7ab86a1.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_01ed17dab92c7012e8221f9bbf3dd35d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_01ed17dab92c7012e8221f9bbf3dd35d.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_22498ddaa3969050f51ad7d6605ca016.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_22498ddaa3969050f51ad7d6605ca016.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_9b2c1fd635a932ef2f91a78e2ddc4977.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_9b2c1fd635a932ef2f91a78e2ddc4977.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_55d3112182f0c9d3d69454ebb0d1e251.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_55d3112182f0c9d3d69454ebb0d1e251.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_fd716bf16e496498f2b9003525f460ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_fd716bf16e496498f2b9003525f460ce.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_7d159754a103af6b4007e472611c94c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_7d159754a103af6b4007e472611c94c8.jpg already downloaded
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F88%252Faa88b82656ba8941472caa6cbaa515db%252Fpa%252FEK78236_5faa44e6fd7d714b1daf6575974f7859.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_5faa44e6fd7d714b1daf6575974f7859.jpg already downloaded
2026-03-30 11:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 555d2526-9b4f-5ec2-a0c4-67aa442d44b2, identifier: EK78236
2026-03-30 11:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 555d2526-9b4f-5ec2-a0c4-67aa442d44b2 with identifier: EK78236
2026-03-30 11:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 555d2526-9b4f-5ec2-a0c4-67aa442d44b2 with identifier: EK78236
2026-03-30 11:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 555d2526-9b4f-5ec2-a0c4-67aa442d44b2 with identifier: EK78236 to the API
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK78236>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:15:16Z',
 'fuel_type': 'diesel',
 'id': '555d2526-9b4f-5ec2-a0c4-67aa442d44b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK78236',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 125519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_edbbf6e94331207e901c3945be92be00.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_4702c4609e4960a8b8eed6d6af12f000.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_872935eb4a2d581cd6d8cb50f7ab86a1.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_01ed17dab92c7012e8221f9bbf3dd35d.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_22498ddaa3969050f51ad7d6605ca016.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_9b2c1fd635a932ef2f91a78e2ddc4977.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_55d3112182f0c9d3d69454ebb0d1e251.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_fd716bf16e496498f2b9003525f460ce.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_7d159754a103af6b4007e472611c94c8.jpg',
                'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_5faa44e6fd7d714b1daf6575974f7859.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_edbbf6e94331207e901c3945be92be00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_4702c4609e4960a8b8eed6d6af12f000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_872935eb4a2d581cd6d8cb50f7ab86a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_01ed17dab92c7012e8221f9bbf3dd35d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_22498ddaa3969050f51ad7d6605ca016.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_9b2c1fd635a932ef2f91a78e2ddc4977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_55d3112182f0c9d3d69454ebb0d1e251.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_fd716bf16e496498f2b9003525f460ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_7d159754a103af6b4007e472611c94c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555d2526-9b4f-5ec2-a0c4-67aa442d44b2/555d2526-9b4f-5ec2-a0c4-67aa442d44b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/88/aa88b82656ba8941472caa6cbaa515db/pa/EK78236_5faa44e6fd7d714b1daf6575974f7859.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK78236%27 HTTP/1.1" 200 None
2026-03-30 11:38:50 [auto1.be] INFO: Saving data for EK78236: {'created_time': 1774870730.561557, 'last_price_update_time': 1774870730.561568, 'auction_closing_time': 1774970116.0}
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK78236') HTTP/1.1" 204 0
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.148(s), this was the 1st time calling it.
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.6234646282801695 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:38:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.559(s), this was the 1st time calling it.
2026-03-30 11:38:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.084115158397127 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM52294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:38:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.815(s), this was the 1st time calling it.
2026-03-30 11:38:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.3634358901187715 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX71695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:07 [scrapy.extensions.logstats] INFO: Crawled 145 pages (at 26 pages/min), scraped 92 items (at 17 items/min)
2026-03-30 11:39:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK69889> (referer: https://www.auto1.com/v1/car-details-view/GK69889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db233dec-b7e5-5329-878d-fbe7a4434b2b with identifier: GK69889
2026-03-30 11:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db233dec-b7e5-5329-878d-fbe7a4434b2b with scrape type 1
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_4114f56e12b879d629ca26aa7386e5be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_4114f56e12b879d629ca26aa7386e5be.jpg not downloaded yet
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_668b3e614fa9921b4ac6f38d2f3ef9e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_668b3e614fa9921b4ac6f38d2f3ef9e6.jpg not downloaded yet
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_c374952cdebd2753982ac52a014c4c3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_c374952cdebd2753982ac52a014c4c3c.jpg not downloaded yet
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_a4c4e579bddcef436ec759f122b5e26f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_a4c4e579bddcef436ec759f122b5e26f.jpg not downloaded yet
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_709430767b5883cedc15d3a11c4f3b51.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_709430767b5883cedc15d3a11c4f3b51.jpg not downloaded yet
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_e3eb362cd333dd29a970d9f80f0b27dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_e3eb362cd333dd29a970d9f80f0b27dd.jpg not downloaded yet
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK55649> (referer: https://www.auto1.com/v1/car-details-view/FK55649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_e3eb362cd333dd29a970d9f80f0b27dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b7c61e-42f6-57f5-bb12-039048a85ae1 with identifier: FK55649
2026-03-30 11:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b7c61e-42f6-57f5-bb12-039048a85ae1 with scrape type 1
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_1ea573ed007ae80fdde357042e35075a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1ea573ed007ae80fdde357042e35075a.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_1b3bbea1c47f630296916a5330e445d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1b3bbea1c47f630296916a5330e445d1.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_807b135cfd3f40635d8091aad506ad63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_807b135cfd3f40635d8091aad506ad63.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_464246d6f69211ed621e4a18b981bc55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_464246d6f69211ed621e4a18b981bc55.jpg not downloaded yet
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_709430767b5883cedc15d3a11c4f3b51.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_9d2abe18416dbc6eca86d88c73226f13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_9d2abe18416dbc6eca86d88c73226f13.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_a27dfb0aae24bc275fd7622e2169daa0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_a27dfb0aae24bc275fd7622e2169daa0.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_de0976b0839148e4551bc2b658af8da7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_de0976b0839148e4551bc2b658af8da7.jpg not downloaded yet
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e0ad0>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_e3eb362cd333dd29a970d9f80f0b27dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_e3eb362cd333dd29a970d9f80f0b27dd.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_0467c97359515681fd6aa471b51c4c09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_0467c97359515681fd6aa471b51c4c09.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_6e6af97f237213b1a69db45114a48891.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_6e6af97f237213b1a69db45114a48891.jpg not downloaded yet
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_09207d8b0e3016db10e096970101f773.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_09207d8b0e3016db10e096970101f773.jpg not downloaded yet
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea25b9d0>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_709430767b5883cedc15d3a11c4f3b51.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_709430767b5883cedc15d3a11c4f3b51.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_807b135cfd3f40635d8091aad506ad63.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_09207d8b0e3016db10e096970101f773.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9852910>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_807b135cfd3f40635d8091aad506ad63.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_807b135cfd3f40635d8091aad506ad63.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_6e6af97f237213b1a69db45114a48891.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebfef710>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_09207d8b0e3016db10e096970101f773.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_09207d8b0e3016db10e096970101f773.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b9110>
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_6e6af97f237213b1a69db45114a48891.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_6e6af97f237213b1a69db45114a48891.jpg saved to cache
2026-03-30 11:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_0467c97359515681fd6aa471b51c4c09.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ab5d0>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_0467c97359515681fd6aa471b51c4c09.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_0467c97359515681fd6aa471b51c4c09.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_de0976b0839148e4551bc2b658af8da7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_a27dfb0aae24bc275fd7622e2169daa0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fbc50>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_de0976b0839148e4551bc2b658af8da7.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_de0976b0839148e4551bc2b658af8da7.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_9d2abe18416dbc6eca86d88c73226f13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9758710>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_a27dfb0aae24bc275fd7622e2169daa0.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_a27dfb0aae24bc275fd7622e2169daa0.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1909d0>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_9d2abe18416dbc6eca86d88c73226f13.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_9d2abe18416dbc6eca86d88c73226f13.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_464246d6f69211ed621e4a18b981bc55.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9758e10>
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_464246d6f69211ed621e4a18b981bc55.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_464246d6f69211ed621e4a18b981bc55.jpg saved to cache
2026-03-30 11:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1b3bbea1c47f630296916a5330e445d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96a7ed0>
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_1b3bbea1c47f630296916a5330e445d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1b3bbea1c47f630296916a5330e445d1.jpg saved to cache
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1ea573ed007ae80fdde357042e35075a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_a4c4e579bddcef436ec759f122b5e26f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:39:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:39:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9732c90>
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fd8%252F5dd87f1fdea7726534860fd505ba2018%252Fpa%252FFK55649_1ea573ed007ae80fdde357042e35075a.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1ea573ed007ae80fdde357042e35075a.jpg saved to cache
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25b7c61e-42f6-57f5-bb12-039048a85ae1
2026-03-30 11:39:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25b7c61e-42f6-57f5-bb12-039048a85ae1, skipping ID generation
2026-03-30 11:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b7c61e-42f6-57f5-bb12-039048a85ae1 with scrape type 1
2026-03-30 11:39:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25b7c61e-42f6-57f5-bb12-039048a85ae1 sending to next pipeline
2026-03-30 11:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25b7c61e-42f6-57f5-bb12-039048a85ae1, identifier: FK55649
2026-03-30 11:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25b7c61e-42f6-57f5-bb12-039048a85ae1 with identifier: FK55649
2026-03-30 11:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25b7c61e-42f6-57f5-bb12-039048a85ae1 with identifier: FK55649
2026-03-30 11:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25b7c61e-42f6-57f5-bb12-039048a85ae1 with identifier: FK55649 to the API
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1ea573ed007ae80fdde357042e35075a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:03:33Z',
 'fuel_type': 'diesel',
 'id': '25b7c61e-42f6-57f5-bb12-039048a85ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK55649',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 209368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4161628,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1ea573ed007ae80fdde357042e35075a.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_1b3bbea1c47f630296916a5330e445d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_807b135cfd3f40635d8091aad506ad63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_464246d6f69211ed621e4a18b981bc55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_9d2abe18416dbc6eca86d88c73226f13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_a27dfb0aae24bc275fd7622e2169daa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_de0976b0839148e4551bc2b658af8da7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_0467c97359515681fd6aa471b51c4c09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_6e6af97f237213b1a69db45114a48891.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b7c61e-42f6-57f5-bb12-039048a85ae1/25b7c61e-42f6-57f5-bb12-039048a85ae1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/d8/5dd87f1fdea7726534860fd505ba2018/pa/FK55649_09207d8b0e3016db10e096970101f773.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK55649%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Saving data for FK55649: {'created_time': 1774870761.096644, 'last_price_update_time': 1774870761.096656, 'auction_closing_time': 1774969413.0}
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK55649') HTTP/1.1" 204 0
2026-03-30 11:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_c374952cdebd2753982ac52a014c4c3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ac4d0>
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_a4c4e579bddcef436ec759f122b5e26f.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_a4c4e579bddcef436ec759f122b5e26f.jpg saved to cache
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_668b3e614fa9921b4ac6f38d2f3ef9e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9731790>
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_c374952cdebd2753982ac52a014c4c3c.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_c374952cdebd2753982ac52a014c4c3c.jpg saved to cache
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_4114f56e12b879d629ca26aa7386e5be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:21 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1757 | hits on page: 40
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for HJ68089: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: VP17023
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP17023%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for VP17023: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: CF49225
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF49225%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for CF49225: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: ST59109
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for XF11904: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: HA15365
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA15365%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for HA15365: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: NN50309
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: RD52510
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: AV31741
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV31741%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for AV31741: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: RJ26699
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ26699%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for RJ26699: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: FL94389
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL94389%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for FL94389: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for MJ87524: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: MX59641
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX59641%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for MX59641: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: EW88607
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW88607%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for EW88607: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for NA83535: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for BV48703: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: JH90909
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH90909%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for JH90909: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: UT07561
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: GN58348
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN58348%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for GN58348: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: XW45158
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: SE67148
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE67148%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for SE67148: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: KP55338
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: ME39543
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME39543%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for ME39543: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: RN25296
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: CD49334
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49334%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for CD49334: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: SG70291
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG70291%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for SG70291: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for MB15920: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: EU38310
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU38310%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for EU38310: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: NL96046
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL96046%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for NL96046: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for CW56663: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: GL12776
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL12776%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for GL12776: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: FA29131
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: MA67469
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: FL73906
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: TR13838
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: KL19623
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL19623%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for KL19623: 0
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: LW89201
2026-03-30 11:39:21 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-30 11:39:21 [auto1.be] INFO: Scrape type for ZC05502: 0
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e1a90>
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_668b3e614fa9921b4ac6f38d2f3ef9e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_668b3e614fa9921b4ac6f38d2f3ef9e6.jpg saved to cache
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96b48d0>
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F5f%252F4c5fc3fc482aff7976c80cde74610ddb%252Fpa%252FGK69889_4114f56e12b879d629ca26aa7386e5be.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_4114f56e12b879d629ca26aa7386e5be.jpg saved to cache
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db233dec-b7e5-5329-878d-fbe7a4434b2b
2026-03-30 11:39:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db233dec-b7e5-5329-878d-fbe7a4434b2b, skipping ID generation
2026-03-30 11:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db233dec-b7e5-5329-878d-fbe7a4434b2b with scrape type 1
2026-03-30 11:39:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db233dec-b7e5-5329-878d-fbe7a4434b2b sending to next pipeline
2026-03-30 11:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db233dec-b7e5-5329-878d-fbe7a4434b2b, identifier: GK69889
2026-03-30 11:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db233dec-b7e5-5329-878d-fbe7a4434b2b with identifier: GK69889
2026-03-30 11:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db233dec-b7e5-5329-878d-fbe7a4434b2b with identifier: GK69889
2026-03-30 11:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db233dec-b7e5-5329-878d-fbe7a4434b2b with identifier: GK69889 to the API
2026-03-30 11:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_4114f56e12b879d629ca26aa7386e5be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:09:22Z',
 'fuel_type': 'petrol',
 'id': 'db233dec-b7e5-5329-878d-fbe7a4434b2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK69889',
 'listing': 'auction',
 'location': 'BE, Herstal',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 91921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_4114f56e12b879d629ca26aa7386e5be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_668b3e614fa9921b4ac6f38d2f3ef9e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_c374952cdebd2753982ac52a014c4c3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_a4c4e579bddcef436ec759f122b5e26f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_709430767b5883cedc15d3a11c4f3b51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db233dec-b7e5-5329-878d-fbe7a4434b2b/db233dec-b7e5-5329-878d-fbe7a4434b2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/5f/4c5fc3fc482aff7976c80cde74610ddb/pa/GK69889_e3eb362cd333dd29a970d9f80f0b27dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.1 Cool & Sound',
 'transmission': 'manual',
 'trim': 'Cool & Sound',
 'year': 2012}
2026-03-30 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69889%27 HTTP/1.1" 200 None
2026-03-30 11:39:22 [auto1.be] INFO: Saving data for GK69889: {'created_time': 1774870762.276246, 'last_price_update_time': 1774870762.27626, 'auction_closing_time': 1774969762.0}
2026-03-30 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GK69889') HTTP/1.1" 204 0
2026-03-30 11:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN89507> (referer: https://www.auto1.com/v1/car-details-view/FN89507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53742c59-7c54-5654-acf7-d336f7cfa96c with identifier: FN89507
2026-03-30 11:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53742c59-7c54-5654-acf7-d336f7cfa96c with scrape type 1
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53742c59-7c54-5654-acf7-d336f7cfa96c
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_b0b76c47f08d5c47f422c43869b3e5ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_b0b76c47f08d5c47f422c43869b3e5ea.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_e4f8d34d94e66f111ac867cbb770d309.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e4f8d34d94e66f111ac867cbb770d309.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_c5fbf7a7473d13ae2497c5e7c6714c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_c5fbf7a7473d13ae2497c5e7c6714c4a.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_501681db204d42bd43d45d0b9148776e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_501681db204d42bd43d45d0b9148776e.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_f79facecb80bd35f83ba2fed22fc94a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_f79facecb80bd35f83ba2fed22fc94a4.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_41a202873a221a9a631a81fad6fc38b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_41a202873a221a9a631a81fad6fc38b8.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_e9fa00829d89a8d8e7490c12c3c58b75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e9fa00829d89a8d8e7490c12c3c58b75.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_e2460740368e53785cffba2352707a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e2460740368e53785cffba2352707a63.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_dc8338a04658289e38a12277f74f0f34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_dc8338a04658289e38a12277f74f0f34.jpg already downloaded
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fcb%252Fc6cb1613802ecad5a7063aa54384e3f9%252Fpa%252FFN89507_12c280934f3d38262623ab79575895d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_12c280934f3d38262623ab79575895d3.jpg already downloaded
2026-03-30 11:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53742c59-7c54-5654-acf7-d336f7cfa96c, identifier: FN89507
2026-03-30 11:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53742c59-7c54-5654-acf7-d336f7cfa96c with identifier: FN89507
2026-03-30 11:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53742c59-7c54-5654-acf7-d336f7cfa96c with identifier: FN89507
2026-03-30 11:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53742c59-7c54-5654-acf7-d336f7cfa96c with identifier: FN89507 to the API
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN89507>
{'auction_title': '',
 'c_o_2_emission_value': 45,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-03-31T15:13:20Z',
 'fuel_type': 'hybrid',
 'id': '53742c59-7c54-5654-acf7-d336f7cfa96c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN89507',
 'listing': 'auction',
 'location': 'Lommel',
 'make': 'Volvo',
 'model': 'S90',
 'odometer': 67975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_b0b76c47f08d5c47f422c43869b3e5ea.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e4f8d34d94e66f111ac867cbb770d309.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_c5fbf7a7473d13ae2497c5e7c6714c4a.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_501681db204d42bd43d45d0b9148776e.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_f79facecb80bd35f83ba2fed22fc94a4.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_41a202873a221a9a631a81fad6fc38b8.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e9fa00829d89a8d8e7490c12c3c58b75.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e2460740368e53785cffba2352707a63.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_dc8338a04658289e38a12277f74f0f34.jpg',
                'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_12c280934f3d38262623ab79575895d3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_b0b76c47f08d5c47f422c43869b3e5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e4f8d34d94e66f111ac867cbb770d309.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_c5fbf7a7473d13ae2497c5e7c6714c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_501681db204d42bd43d45d0b9148776e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_f79facecb80bd35f83ba2fed22fc94a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_41a202873a221a9a631a81fad6fc38b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e9fa00829d89a8d8e7490c12c3c58b75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_e2460740368e53785cffba2352707a63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_dc8338a04658289e38a12277f74f0f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53742c59-7c54-5654-acf7-d336f7cfa96c/53742c59-7c54-5654-acf7-d336f7cfa96c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/cb/c6cb1613802ecad5a7063aa54384e3f9/pa/FN89507_12c280934f3d38262623ab79575895d3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-30 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN89507%27 HTTP/1.1" 200 None
2026-03-30 11:39:26 [auto1.be] INFO: Saving data for FN89507: {'created_time': 1774870766.056143, 'last_price_update_time': 1774870766.056154, 'auction_closing_time': 1774970000.0}
2026-03-30 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN89507') HTTP/1.1" 204 0
2026-03-30 11:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV61440> (referer: https://www.auto1.com/v1/car-details-view/VV61440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5 with identifier: VV61440
2026-03-30 11:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5 with scrape type 1
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_c260795e7e84d15a542671447159007d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_c260795e7e84d15a542671447159007d.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_00eb1edd65a5df2d1923efe6ba896f1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_00eb1edd65a5df2d1923efe6ba896f1c.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_11497749f075a727f7d03ca021753eeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_11497749f075a727f7d03ca021753eeb.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_fcdd14b40e7dbb3b489b8ffc159fc04b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_fcdd14b40e7dbb3b489b8ffc159fc04b.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_9379f1f8ffc74febef66e5c81dc4eb95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_9379f1f8ffc74febef66e5c81dc4eb95.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_a3154e347bd6b7af4b7af800880fb946.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_a3154e347bd6b7af4b7af800880fb946.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_2678fc10e1f1a0b41693254db910b045.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_2678fc10e1f1a0b41693254db910b045.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_8a93b44b774cf6b0c54e677f19146c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_8a93b44b774cf6b0c54e677f19146c07.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_3f3e79fbe8421ad544d569c98e2d49fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_3f3e79fbe8421ad544d569c98e2d49fd.jpg already downloaded
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F41%252Ff941fa6b4d0c0cd80d4b509790e7de6d%252Fpa%252FVV61440_8c6714cc522a8961e7346012b7fd7f00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_8c6714cc522a8961e7346012b7fd7f00.jpg already downloaded
2026-03-30 11:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5, identifier: VV61440
2026-03-30 11:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5 with identifier: VV61440
2026-03-30 11:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5 with identifier: VV61440
2026-03-30 11:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aef6818-fd56-5ecf-ab38-ed9a6a5aede5 with identifier: VV61440 to the API
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV61440>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:35:17Z',
 'fuel_type': 'petrol',
 'id': '6aef6818-fd56-5ecf-ab38-ed9a6a5aede5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV61440',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 109426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_c260795e7e84d15a542671447159007d.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_00eb1edd65a5df2d1923efe6ba896f1c.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_11497749f075a727f7d03ca021753eeb.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_fcdd14b40e7dbb3b489b8ffc159fc04b.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_9379f1f8ffc74febef66e5c81dc4eb95.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_a3154e347bd6b7af4b7af800880fb946.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_2678fc10e1f1a0b41693254db910b045.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_8a93b44b774cf6b0c54e677f19146c07.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_3f3e79fbe8421ad544d569c98e2d49fd.jpg',
                'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_8c6714cc522a8961e7346012b7fd7f00.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_c260795e7e84d15a542671447159007d.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_00eb1edd65a5df2d1923efe6ba896f1c.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_11497749f075a727f7d03ca021753eeb.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_fcdd14b40e7dbb3b489b8ffc159fc04b.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_9379f1f8ffc74febef66e5c81dc4eb95.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_a3154e347bd6b7af4b7af800880fb946.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_2678fc10e1f1a0b41693254db910b045.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_8a93b44b774cf6b0c54e677f19146c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_3f3e79fbe8421ad544d569c98e2d49fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aef6818-fd56-5ecf-ab38-ed9a6a5aede5/6aef6818-fd56-5ecf-ab38-ed9a6a5aede5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/41/f941fa6b4d0c0cd80d4b509790e7de6d/pa/VV61440_8c6714cc522a8961e7346012b7fd7f00.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV61440%27 HTTP/1.1" 200 None
2026-03-30 11:39:34 [auto1.be] INFO: Saving data for VV61440: {'created_time': 1774870774.347173, 'last_price_update_time': 1774870774.347184, 'auction_closing_time': 1774971317.0}
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VV61440') HTTP/1.1" 204 0
2026-03-30 11:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN07894> (referer: https://www.auto1.com/v1/car-details-view/ZN07894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae6db2a-1808-558c-8c41-7a96734ab64b with identifier: ZN07894
2026-03-30 11:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae6db2a-1808-558c-8c41-7a96734ab64b with scrape type 1
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_7681c26eae820544426ab259016b841f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_7681c26eae820544426ab259016b841f.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_90573ab5e687cb5529cb5d74029f84c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_90573ab5e687cb5529cb5d74029f84c6.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_3114a5cbd70db70f05392476657e485e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_3114a5cbd70db70f05392476657e485e.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_098b4082e0c1f016c4e7a0603c1505d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_098b4082e0c1f016c4e7a0603c1505d6.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_67605dc833bbb9d0864c0fb9111aa302.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_67605dc833bbb9d0864c0fb9111aa302.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_55bfdfc3cf6e4b9529cea35972980b8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_55bfdfc3cf6e4b9529cea35972980b8c.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_f1a930fc3cbaee07522816885355afe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_f1a930fc3cbaee07522816885355afe0.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_40d1e110c2a001fdb97d1eb0f63800a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_40d1e110c2a001fdb97d1eb0f63800a8.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_515a78f2da32cd52a3c3b47f52fff79c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_515a78f2da32cd52a3c3b47f52fff79c.jpg not downloaded yet
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_e42b381eb59673006c9bf00251e26571.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_e42b381eb59673006c9bf00251e26571.jpg not downloaded yet
2026-03-30 11:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL22042> (referer: https://www.auto1.com/v1/car-details-view/AL22042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_e42b381eb59673006c9bf00251e26571.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b with identifier: AL22042
2026-03-30 11:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b with scrape type 1
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_c2ecb0abaf8273ee93f53f508001610f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_c2ecb0abaf8273ee93f53f508001610f.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_e331aa091dbdad1f61f38d2c113dd8bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e331aa091dbdad1f61f38d2c113dd8bf.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_ddd6c9949a1728c9fbac9557091d4968.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ddd6c9949a1728c9fbac9557091d4968.jpg not downloaded yet
2026-03-30 11:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_515a78f2da32cd52a3c3b47f52fff79c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_381f63cfa74c9baf13cebb486ad30a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_381f63cfa74c9baf13cebb486ad30a8d.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_3ad289551a3851894eb5cb2263097a97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_3ad289551a3851894eb5cb2263097a97.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_ed03c191c3cc65e7f39cca3f045a3738.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ed03c191c3cc65e7f39cca3f045a3738.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_994d9e2b6bf0d73e0fb3a967655dc116.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_994d9e2b6bf0d73e0fb3a967655dc116.jpg not downloaded yet
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d9750>
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_e42b381eb59673006c9bf00251e26571.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_e42b381eb59673006c9bf00251e26571.jpg saved to cache
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_e6a3830a2433c9320684cc08d1ca1ce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e6a3830a2433c9320684cc08d1ca1ce3.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_fd67e878904a0a056499154878b643c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_fd67e878904a0a056499154878b643c1.jpg not downloaded yet
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_9494681970bbc9ccfebb8d30d0367161.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_9494681970bbc9ccfebb8d30d0367161.jpg not downloaded yet
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea25b2d0>
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_515a78f2da32cd52a3c3b47f52fff79c.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_515a78f2da32cd52a3c3b47f52fff79c.jpg saved to cache
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ddd6c9949a1728c9fbac9557091d4968.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e78d0>
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_ddd6c9949a1728c9fbac9557091d4968.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ddd6c9949a1728c9fbac9557091d4968.jpg saved to cache
2026-03-30 11:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_9494681970bbc9ccfebb8d30d0367161.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d3fd0>
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_9494681970bbc9ccfebb8d30d0367161.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_9494681970bbc9ccfebb8d30d0367161.jpg saved to cache
2026-03-30 11:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_fd67e878904a0a056499154878b643c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97dcad0>
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_fd67e878904a0a056499154878b643c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_fd67e878904a0a056499154878b643c1.jpg saved to cache
2026-03-30 11:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e6a3830a2433c9320684cc08d1ca1ce3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d2f10>
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_e6a3830a2433c9320684cc08d1ca1ce3.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e6a3830a2433c9320684cc08d1ca1ce3.jpg saved to cache
2026-03-30 11:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_994d9e2b6bf0d73e0fb3a967655dc116.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97df850>
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_994d9e2b6bf0d73e0fb3a967655dc116.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_994d9e2b6bf0d73e0fb3a967655dc116.jpg saved to cache
2026-03-30 11:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ed03c191c3cc65e7f39cca3f045a3738.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d1490>
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_ed03c191c3cc65e7f39cca3f045a3738.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ed03c191c3cc65e7f39cca3f045a3738.jpg saved to cache
2026-03-30 11:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_3ad289551a3851894eb5cb2263097a97.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea206450>
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_3ad289551a3851894eb5cb2263097a97.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_3ad289551a3851894eb5cb2263097a97.jpg saved to cache
2026-03-30 11:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_381f63cfa74c9baf13cebb486ad30a8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9820950>
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_381f63cfa74c9baf13cebb486ad30a8d.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_381f63cfa74c9baf13cebb486ad30a8d.jpg saved to cache
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e331aa091dbdad1f61f38d2c113dd8bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_c2ecb0abaf8273ee93f53f508001610f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12c710>
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_e331aa091dbdad1f61f38d2c113dd8bf.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e331aa091dbdad1f61f38d2c113dd8bf.jpg saved to cache
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_40d1e110c2a001fdb97d1eb0f63800a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d0250>
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252Fc1%252F0dc1a98e908b537b3a9d1aad7791f5c3%252Fpa%252FAL22042_c2ecb0abaf8273ee93f53f508001610f.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_c2ecb0abaf8273ee93f53f508001610f.jpg saved to cache
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b
2026-03-30 11:39:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b, skipping ID generation
2026-03-30 11:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b with scrape type 1
2026-03-30 11:39:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b sending to next pipeline
2026-03-30 11:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b, identifier: AL22042
2026-03-30 11:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b with identifier: AL22042
2026-03-30 11:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b with identifier: AL22042
2026-03-30 11:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b with identifier: AL22042 to the API
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_c2ecb0abaf8273ee93f53f508001610f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:22:39Z',
 'fuel_type': 'diesel',
 'id': '95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL22042',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 132616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_c2ecb0abaf8273ee93f53f508001610f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e331aa091dbdad1f61f38d2c113dd8bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ddd6c9949a1728c9fbac9557091d4968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_381f63cfa74c9baf13cebb486ad30a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_3ad289551a3851894eb5cb2263097a97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2781370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_ed03c191c3cc65e7f39cca3f045a3738.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_994d9e2b6bf0d73e0fb3a967655dc116.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_e6a3830a2433c9320684cc08d1ca1ce3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_fd67e878904a0a056499154878b643c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b/95a7ead0-7ac2-53bc-b13a-1ef9ad9a5d3b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/c1/0dc1a98e908b537b3a9d1aad7791f5c3/pa/AL22042_9494681970bbc9ccfebb8d30d0367161.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2018}
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL22042%27 HTTP/1.1" 200 None
2026-03-30 11:39:52 [auto1.be] INFO: Saving data for AL22042: {'created_time': 1774870792.947064, 'last_price_update_time': 1774870792.947075, 'auction_closing_time': 1774970559.0}
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AL22042') HTTP/1.1" 204 0
2026-03-30 11:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_f1a930fc3cbaee07522816885355afe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2340d0>
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_40d1e110c2a001fdb97d1eb0f63800a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_40d1e110c2a001fdb97d1eb0f63800a8.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e975b650>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_f1a930fc3cbaee07522816885355afe0.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_f1a930fc3cbaee07522816885355afe0.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_55bfdfc3cf6e4b9529cea35972980b8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_67605dc833bbb9d0864c0fb9111aa302.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97dda50>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_55bfdfc3cf6e4b9529cea35972980b8c.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_55bfdfc3cf6e4b9529cea35972980b8c.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_098b4082e0c1f016c4e7a0603c1505d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97de590>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_67605dc833bbb9d0864c0fb9111aa302.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_67605dc833bbb9d0864c0fb9111aa302.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_3114a5cbd70db70f05392476657e485e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9732550>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_098b4082e0c1f016c4e7a0603c1505d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_098b4082e0c1f016c4e7a0603c1505d6.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_90573ab5e687cb5529cb5d74029f84c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22e410>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_3114a5cbd70db70f05392476657e485e.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_3114a5cbd70db70f05392476657e485e.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_7681c26eae820544426ab259016b841f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e08d0>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_90573ab5e687cb5529cb5d74029f84c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_90573ab5e687cb5529cb5d74029f84c6.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2344d0>
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fb9%252F35b9ab3a4908a5eec7b2e12249209b13%252Fpa%252FZN07894_7681c26eae820544426ab259016b841f.jpg') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_7681c26eae820544426ab259016b841f.jpg saved to cache
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ae6db2a-1808-558c-8c41-7a96734ab64b
2026-03-30 11:39:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ae6db2a-1808-558c-8c41-7a96734ab64b, skipping ID generation
2026-03-30 11:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae6db2a-1808-558c-8c41-7a96734ab64b with scrape type 1
2026-03-30 11:39:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ae6db2a-1808-558c-8c41-7a96734ab64b sending to next pipeline
2026-03-30 11:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ae6db2a-1808-558c-8c41-7a96734ab64b, identifier: ZN07894
2026-03-30 11:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ae6db2a-1808-558c-8c41-7a96734ab64b with identifier: ZN07894
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 11:39:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ae6db2a-1808-558c-8c41-7a96734ab64b with identifier: ZN07894
2026-03-30 11:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ae6db2a-1808-558c-8c41-7a96734ab64b with identifier: ZN07894 to the API
2026-03-30 11:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_7681c26eae820544426ab259016b841f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:16:54Z',
 'fuel_type': 'petrol',
 'id': '7ae6db2a-1808-558c-8c41-7a96734ab64b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN07894',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 134761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_7681c26eae820544426ab259016b841f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_90573ab5e687cb5529cb5d74029f84c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_3114a5cbd70db70f05392476657e485e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_098b4082e0c1f016c4e7a0603c1505d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_67605dc833bbb9d0864c0fb9111aa302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_55bfdfc3cf6e4b9529cea35972980b8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_f1a930fc3cbaee07522816885355afe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_40d1e110c2a001fdb97d1eb0f63800a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_515a78f2da32cd52a3c3b47f52fff79c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ae6db2a-1808-558c-8c41-7a96734ab64b/7ae6db2a-1808-558c-8c41-7a96734ab64b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/b9/35b9ab3a4908a5eec7b2e12249209b13/pa/ZN07894_e42b381eb59673006c9bf00251e26571.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 307 1.6 Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2001}
2026-03-30 11:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN07894%27 HTTP/1.1" 200 None
2026-03-30 11:39:54 [auto1.be] INFO: Saving data for ZN07894: {'created_time': 1774870794.29648, 'last_price_update_time': 1774870794.296491, 'auction_closing_time': 1774970214.0}
2026-03-30 11:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN07894') HTTP/1.1" 204 0
2026-03-30 11:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL30986> (referer: https://www.auto1.com/v1/car-details-view/XL30986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4362fe8-c275-51d0-aa4b-26e3de550f96 with identifier: XL30986
2026-03-30 11:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4362fe8-c275-51d0-aa4b-26e3de550f96 with scrape type 1
2026-03-30 11:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_058d8e23891ed37b06a176d0635dd8e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_058d8e23891ed37b06a176d0635dd8e7.jpg not downloaded yet
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_1b5296a58070f2e8f3669fb0b68be364.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1b5296a58070f2e8f3669fb0b68be364.jpg not downloaded yet
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_e8a775b4d85160892b085033fba2f14a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_e8a775b4d85160892b085033fba2f14a.jpg not downloaded yet
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_2fba680276de35456693e6acde353ec2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2fba680276de35456693e6acde353ec2.jpg not downloaded yet
2026-03-30 11:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_531ba4334d10759be28332684d238c03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_531ba4334d10759be28332684d238c03.jpg not downloaded yet
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_1cb3fabccdab6bfa90917f0375096bb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1cb3fabccdab6bfa90917f0375096bb2.jpg not downloaded yet
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_fd0f7052017a1e0eb08ee0c18363b26a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_fd0f7052017a1e0eb08ee0c18363b26a.jpg not downloaded yet
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_2402b131ab22d151c675e01771808008.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2402b131ab22d151c675e01771808008.jpg not downloaded yet
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_ceceab9cb8d465d1cb068a661db6e1c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_ceceab9cb8d465d1cb068a661db6e1c8.jpg not downloaded yet
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_93610c2a4cdfa166d06c51caaaad8aa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_93610c2a4cdfa166d06c51caaaad8aa8.jpg not downloaded yet
2026-03-30 11:40:07 [scrapy.extensions.logstats] INFO: Crawled 153 pages (at 8 pages/min), scraped 98 items (at 6 items/min)
2026-03-30 11:40:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM52294> (referer: https://www.auto1.com/v1/car-details-view/LM52294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_93610c2a4cdfa166d06c51caaaad8aa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 with identifier: LM52294
2026-03-30 11:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 with scrape type 1
2026-03-30 11:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_16da2015ff408b2c94f6854a2414feb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_16da2015ff408b2c94f6854a2414feb3.jpg not downloaded yet
2026-03-30 11:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg not downloaded yet
2026-03-30 11:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_bae834408e162bacaf123b96987f4df7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_bae834408e162bacaf123b96987f4df7.jpg not downloaded yet
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_acbfb88350ff5af98b581f0e62a0aa68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_acbfb88350ff5af98b581f0e62a0aa68.jpg not downloaded yet
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_deec2078cf80fe499c2ba269419c1dd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_deec2078cf80fe499c2ba269419c1dd7.jpg not downloaded yet
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_4bfe72f4f1eac48a018d7d7f0782767d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_4bfe72f4f1eac48a018d7d7f0782767d.jpg not downloaded yet
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea218cd0>
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_93610c2a4cdfa166d06c51caaaad8aa8.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_93610c2a4cdfa166d06c51caaaad8aa8.jpg saved to cache
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_88ef0d40d1a043fa13037eab0de5ec05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_88ef0d40d1a043fa13037eab0de5ec05.jpg not downloaded yet
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_46691548a2231e7c11a58d861202648b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_46691548a2231e7c11a58d861202648b.jpg not downloaded yet
2026-03-30 11:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_ceceab9cb8d465d1cb068a661db6e1c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_dfc9db2de2f06bc9bc94b73ac7aa4358.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_dfc9db2de2f06bc9bc94b73ac7aa4358.jpg not downloaded yet
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_53b4a4404d34537552a77e5f0f0ebde5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_53b4a4404d34537552a77e5f0f0ebde5.jpg not downloaded yet
2026-03-30 11:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_46691548a2231e7c11a58d861202648b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea214190>
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_ceceab9cb8d465d1cb068a661db6e1c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_ceceab9cb8d465d1cb068a661db6e1c8.jpg saved to cache
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e50d0>
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_46691548a2231e7c11a58d861202648b.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_46691548a2231e7c11a58d861202648b.jpg saved to cache
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_53b4a4404d34537552a77e5f0f0ebde5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0b83d0>
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_53b4a4404d34537552a77e5f0f0ebde5.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_53b4a4404d34537552a77e5f0f0ebde5.jpg saved to cache
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_dfc9db2de2f06bc9bc94b73ac7aa4358.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:40:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9749c90>
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_dfc9db2de2f06bc9bc94b73ac7aa4358.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_dfc9db2de2f06bc9bc94b73ac7aa4358.jpg saved to cache
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_88ef0d40d1a043fa13037eab0de5ec05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX71695> (referer: https://www.auto1.com/v1/car-details-view/LX71695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9758cd0>
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_88ef0d40d1a043fa13037eab0de5ec05.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_88ef0d40d1a043fa13037eab0de5ec05.jpg saved to cache
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba3db0a-4621-5420-937e-ec0cdba5cc9c with identifier: LX71695
2026-03-30 11:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c with scrape type 1
2026-03-30 11:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_18c438c26a62ef74b85cd205ad6676f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_18c438c26a62ef74b85cd205ad6676f0.jpg not downloaded yet
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_deec2078cf80fe499c2ba269419c1dd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_27783eaa28f8b59662562f79867977d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_27783eaa28f8b59662562f79867977d1.jpg not downloaded yet
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_a05ee646d5a9a8327a81eab646a667f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_a05ee646d5a9a8327a81eab646a667f1.jpg not downloaded yet
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_4bfe72f4f1eac48a018d7d7f0782767d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_e07395bb337041808df420779acce9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_e07395bb337041808df420779acce9e5.jpg not downloaded yet
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_eb1dda66cf5570ae08bd8d149bf4455c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_eb1dda66cf5570ae08bd8d149bf4455c.jpg not downloaded yet
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_b62f52f94ef71c69cb629fa2ba5fe4b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_b62f52f94ef71c69cb629fa2ba5fe4b2.jpg not downloaded yet
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_18c438c26a62ef74b85cd205ad6676f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:40:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:40:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea114d50>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_deec2078cf80fe499c2ba269419c1dd7.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_deec2078cf80fe499c2ba269419c1dd7.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_b62f52f94ef71c69cb629fa2ba5fe4b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea25a810>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_4bfe72f4f1eac48a018d7d7f0782767d.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_4bfe72f4f1eac48a018d7d7f0782767d.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_a05ee646d5a9a8327a81eab646a667f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e0f50>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_18c438c26a62ef74b85cd205ad6676f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_18c438c26a62ef74b85cd205ad6676f0.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_eb1dda66cf5570ae08bd8d149bf4455c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_e07395bb337041808df420779acce9e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a2a50>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_b62f52f94ef71c69cb629fa2ba5fe4b2.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_b62f52f94ef71c69cb629fa2ba5fe4b2.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e4210>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_a05ee646d5a9a8327a81eab646a667f1.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_a05ee646d5a9a8327a81eab646a667f1.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_27783eaa28f8b59662562f79867977d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea20acd0>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_eb1dda66cf5570ae08bd8d149bf4455c.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_eb1dda66cf5570ae08bd8d149bf4455c.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_bae834408e162bacaf123b96987f4df7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22c350>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_e07395bb337041808df420779acce9e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_e07395bb337041808df420779acce9e5.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_acbfb88350ff5af98b581f0e62a0aa68.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea20a110>
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F8b%252Ffe8b84dd0c78c1a9939b6b480a4fbdea%252Fpa%252FLX71695_27783eaa28f8b59662562f79867977d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_27783eaa28f8b59662562f79867977d1.jpg saved to cache
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c
2026-03-30 11:40:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ba3db0a-4621-5420-937e-ec0cdba5cc9c, skipping ID generation
2026-03-30 11:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c with scrape type 1
2026-03-30 11:40:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ba3db0a-4621-5420-937e-ec0cdba5cc9c sending to next pipeline
2026-03-30 11:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ba3db0a-4621-5420-937e-ec0cdba5cc9c, identifier: LX71695
2026-03-30 11:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ba3db0a-4621-5420-937e-ec0cdba5cc9c with identifier: LX71695
2026-03-30 11:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ba3db0a-4621-5420-937e-ec0cdba5cc9c with identifier: LX71695
2026-03-30 11:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ba3db0a-4621-5420-937e-ec0cdba5cc9c with identifier: LX71695 to the API
2026-03-30 11:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_27783eaa28f8b59662562f79867977d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:35:46Z',
 'fuel_type': 'petrol',
 'id': '4ba3db0a-4621-5420-937e-ec0cdba5cc9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX71695',
 'listing': 'auction',
 'location': 'BE, Wauthier-Braine',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 270526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_18c438c26a62ef74b85cd205ad6676f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_27783eaa28f8b59662562f79867977d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_a05ee646d5a9a8327a81eab646a667f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_e07395bb337041808df420779acce9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_eb1dda66cf5570ae08bd8d149bf4455c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ba3db0a-4621-5420-937e-ec0cdba5cc9c/4ba3db0a-4621-5420-937e-ec0cdba5cc9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/8b/fe8b84dd0c78c1a9939b6b480a4fbdea/pa/LX71695_b62f52f94ef71c69cb629fa2ba5fe4b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.2 Xmod Selection',
 'transmission': 'manual',
 'trim': 'Xmod Selection',
 'year': 2016}
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX71695%27 HTTP/1.1" 200 None
2026-03-30 11:40:13 [auto1.be] INFO: Saving data for LX71695: {'created_time': 1774870813.135699, 'last_price_update_time': 1774870813.13571, 'auction_closing_time': 1774971346.0}
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LX71695') HTTP/1.1" 204 0
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e981b2d0>
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_bae834408e162bacaf123b96987f4df7.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_bae834408e162bacaf123b96987f4df7.jpg saved to cache
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea191c90>
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_acbfb88350ff5af98b581f0e62a0aa68.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_acbfb88350ff5af98b581f0e62a0aa68.jpg saved to cache
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_16da2015ff408b2c94f6854a2414feb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:40:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea25bb90>
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_16da2015ff408b2c94f6854a2414feb3.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_16da2015ff408b2c94f6854a2414feb3.jpg saved to cache
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea217050>
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F11%252F5811a3ee86828a4288d21c9e85353a03%252Fpa%252FLM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg saved to cache
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7
2026-03-30 11:40:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7, skipping ID generation
2026-03-30 11:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 with scrape type 1
2026-03-30 11:40:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 sending to next pipeline
2026-03-30 11:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7, identifier: LM52294
2026-03-30 11:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 with identifier: LM52294
2026-03-30 11:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 with identifier: LM52294
2026-03-30 11:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5da39ed1-aaaf-59fc-b3e6-c4f229d158d7 with identifier: LM52294 to the API
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:03:20Z',
 'fuel_type': 'diesel',
 'id': '5da39ed1-aaaf-59fc-b3e6-c4f229d158d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM52294',
 'listing': 'auction',
 'location': 'BE, Oudenaarde',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 147752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 420184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_16da2015ff408b2c94f6854a2414feb3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_32359990e0bc4d66208e5f7ec87f2afe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_bae834408e162bacaf123b96987f4df7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_acbfb88350ff5af98b581f0e62a0aa68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_deec2078cf80fe499c2ba269419c1dd7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_4bfe72f4f1eac48a018d7d7f0782767d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_88ef0d40d1a043fa13037eab0de5ec05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_46691548a2231e7c11a58d861202648b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393597,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_dfc9db2de2f06bc9bc94b73ac7aa4358.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da39ed1-aaaf-59fc-b3e6-c4f229d158d7/5da39ed1-aaaf-59fc-b3e6-c4f229d158d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 386952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/11/5811a3ee86828a4288d21c9e85353a03/pa/LM52294_53b4a4404d34537552a77e5f0f0ebde5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 1.6 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM52294%27 HTTP/1.1" 200 None
2026-03-30 11:40:13 [auto1.be] INFO: Saving data for LM52294: {'created_time': 1774870813.983168, 'last_price_update_time': 1774870813.983181, 'auction_closing_time': 1774969400.0}
2026-03-30 11:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM52294') HTTP/1.1" 204 0
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2402b131ab22d151c675e01771808008.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_fd0f7052017a1e0eb08ee0c18363b26a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_531ba4334d10759be28332684d238c03.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1cb3fabccdab6bfa90917f0375096bb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9820fd0>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_2402b131ab22d151c675e01771808008.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2402b131ab22d151c675e01771808008.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b2850>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_fd0f7052017a1e0eb08ee0c18363b26a.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_fd0f7052017a1e0eb08ee0c18363b26a.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaee8710>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_531ba4334d10759be28332684d238c03.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_531ba4334d10759be28332684d238c03.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98214d0>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_1cb3fabccdab6bfa90917f0375096bb2.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1cb3fabccdab6bfa90917f0375096bb2.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2fba680276de35456693e6acde353ec2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_e8a775b4d85160892b085033fba2f14a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_058d8e23891ed37b06a176d0635dd8e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1b5296a58070f2e8f3669fb0b68be364.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9742710>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_2fba680276de35456693e6acde353ec2.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2fba680276de35456693e6acde353ec2.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a7a90>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_e8a775b4d85160892b085033fba2f14a.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_e8a775b4d85160892b085033fba2f14a.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97594d0>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_058d8e23891ed37b06a176d0635dd8e7.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_058d8e23891ed37b06a176d0635dd8e7.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea117850>
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F61%252F2961ee346fe45fc20e1e8d996cfe4806%252Fpa%252FXL30986_1b5296a58070f2e8f3669fb0b68be364.jpg') HTTP/1.1" 204 0
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1b5296a58070f2e8f3669fb0b68be364.jpg saved to cache
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4362fe8-c275-51d0-aa4b-26e3de550f96
2026-03-30 11:40:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4362fe8-c275-51d0-aa4b-26e3de550f96, skipping ID generation
2026-03-30 11:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4362fe8-c275-51d0-aa4b-26e3de550f96 with scrape type 1
2026-03-30 11:40:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4362fe8-c275-51d0-aa4b-26e3de550f96 sending to next pipeline
2026-03-30 11:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d4362fe8-c275-51d0-aa4b-26e3de550f96, identifier: XL30986
2026-03-30 11:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d4362fe8-c275-51d0-aa4b-26e3de550f96 with identifier: XL30986
2026-03-30 11:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d4362fe8-c275-51d0-aa4b-26e3de550f96 with identifier: XL30986
2026-03-30 11:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d4362fe8-c275-51d0-aa4b-26e3de550f96 with identifier: XL30986 to the API
2026-03-30 11:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1b5296a58070f2e8f3669fb0b68be364.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:09:53Z',
 'fuel_type': 'diesel',
 'id': 'd4362fe8-c275-51d0-aa4b-26e3de550f96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL30986',
 'listing': 'auction',
 'location': 'BE, Seraing',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 54213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_058d8e23891ed37b06a176d0635dd8e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1b5296a58070f2e8f3669fb0b68be364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_e8a775b4d85160892b085033fba2f14a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2fba680276de35456693e6acde353ec2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_531ba4334d10759be28332684d238c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_1cb3fabccdab6bfa90917f0375096bb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_fd0f7052017a1e0eb08ee0c18363b26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_2402b131ab22d151c675e01771808008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_ceceab9cb8d465d1cb068a661db6e1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4362fe8-c275-51d0-aa4b-26e3de550f96/d4362fe8-c275-51d0-aa4b-26e3de550f96_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/61/2961ee346fe45fc20e1e8d996cfe4806/pa/XL30986_93610c2a4cdfa166d06c51caaaad8aa8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 11:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL30986%27 HTTP/1.1" 200 None
2026-03-30 11:40:15 [auto1.be] INFO: Saving data for XL30986: {'created_time': 1774870815.110011, 'last_price_update_time': 1774870815.110021, 'auction_closing_time': 1774969793.0}
2026-03-30 11:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL30986') HTTP/1.1" 204 0
2026-03-30 11:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN29378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW90650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:46 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1758 | hits on page: 40
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for ZC05502: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: AG54530
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: UU73016
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: YG75749
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG75749%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for YG75749: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: FU28808
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU28808%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for FU28808: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for MS70949: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: CX41368
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX41368%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for CX41368: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: BT12815
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: PY47802
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY47802%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for PY47802: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: RD37587
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD37587%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for RD37587: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: SG64560
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG64560%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for SG64560: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: XL28387
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL28387%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for XL28387: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: XZ87385
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for WR41774: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for DT02833: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: ZV23610
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV23610%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for ZV23610: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: JT53562
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: FH19686
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: NH91226
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH91226%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for NH91226: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for ZY23736: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: LC68044
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC68044%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for LC68044: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: FM77705
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for ZH14526: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: TY33491
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: HA32985
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA32985%27 HTTP/1.1" 200 None
2026-03-30 11:40:46 [auto1.be] INFO: Scrape type for HA32985: 0
2026-03-30 11:40:46 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-30 11:40:47 [auto1.be] INFO: Scrape type for VU67376: 0
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: TS76065
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: TK82832
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-30 11:40:47 [auto1.be] INFO: Scrape type for DH79590: 0
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: VP95014
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-30 11:40:47 [auto1.be] INFO: Scrape type for VL86303: 0
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-30 11:40:47 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-30 11:40:47 [auto1.be] INFO: Scrape type for DY90857: 0
2026-03-30 11:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB18656> (referer: https://www.auto1.com/v1/car-details-view/CB18656/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99217b82-87bd-520e-8d9d-d90db39747fe with identifier: CB18656
2026-03-30 11:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99217b82-87bd-520e-8d9d-d90db39747fe with scrape type 1
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99217b82-87bd-520e-8d9d-d90db39747fe
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_af4b0ddb86941833ed0a066fe618a7d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_af4b0ddb86941833ed0a066fe618a7d7.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_b004f9d9b7b913ac1edc3fbb5c102893.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_b004f9d9b7b913ac1edc3fbb5c102893.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_4421cb7c11ab2e8622e186e6191b4d81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_4421cb7c11ab2e8622e186e6191b4d81.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_25a6a9e03cd34fb5d7b7436161a87b69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_25a6a9e03cd34fb5d7b7436161a87b69.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_30aa3589f154e5b17ed938d5cde0b971.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_30aa3589f154e5b17ed938d5cde0b971.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_87e0f849e99270b2263a8bc117eb36f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_87e0f849e99270b2263a8bc117eb36f0.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_6d708582bbee425f4e5228f9c991c4e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_6d708582bbee425f4e5228f9c991c4e0.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_8b1a50e091ce042ca8775d2d6d6ab200.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_8b1a50e091ce042ca8775d2d6d6ab200.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_97e5bd579ba5220b9da75676a1ead4d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_97e5bd579ba5220b9da75676a1ead4d1.jpg already downloaded
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F3f%252F363fb6f4ee5a764e78dbc2cd48080ccb%252Fpa%252FCB18656_b1d6c73688914045d5be76874a43e837.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_b1d6c73688914045d5be76874a43e837.jpg already downloaded
2026-03-30 11:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99217b82-87bd-520e-8d9d-d90db39747fe, identifier: CB18656
2026-03-30 11:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99217b82-87bd-520e-8d9d-d90db39747fe with identifier: CB18656
2026-03-30 11:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99217b82-87bd-520e-8d9d-d90db39747fe with identifier: CB18656
2026-03-30 11:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99217b82-87bd-520e-8d9d-d90db39747fe with identifier: CB18656 to the API
2026-03-30 11:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB18656>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:45:11Z',
 'fuel_type': 'petrol',
 'id': '99217b82-87bd-520e-8d9d-d90db39747fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB18656',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 194547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_af4b0ddb86941833ed0a066fe618a7d7.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_b004f9d9b7b913ac1edc3fbb5c102893.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_4421cb7c11ab2e8622e186e6191b4d81.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_25a6a9e03cd34fb5d7b7436161a87b69.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_30aa3589f154e5b17ed938d5cde0b971.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_87e0f849e99270b2263a8bc117eb36f0.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_6d708582bbee425f4e5228f9c991c4e0.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_8b1a50e091ce042ca8775d2d6d6ab200.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_97e5bd579ba5220b9da75676a1ead4d1.jpg',
                'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_b1d6c73688914045d5be76874a43e837.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_af4b0ddb86941833ed0a066fe618a7d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_b004f9d9b7b913ac1edc3fbb5c102893.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_4421cb7c11ab2e8622e186e6191b4d81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2365023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_25a6a9e03cd34fb5d7b7436161a87b69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2415910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_30aa3589f154e5b17ed938d5cde0b971.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_87e0f849e99270b2263a8bc117eb36f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2509212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_6d708582bbee425f4e5228f9c991c4e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_8b1a50e091ce042ca8775d2d6d6ab200.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2405215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_97e5bd579ba5220b9da75676a1ead4d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99217b82-87bd-520e-8d9d-d90db39747fe/99217b82-87bd-520e-8d9d-d90db39747fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475104,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/3f/363fb6f4ee5a764e78dbc2cd48080ccb/pa/CB18656_b1d6c73688914045d5be76874a43e837.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 11:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB18656%27 HTTP/1.1" 200 None
2026-03-30 11:40:49 [auto1.be] INFO: Saving data for CB18656: {'created_time': 1774870849.211502, 'last_price_update_time': 1774870849.211516, 'auction_closing_time': 1774971911.0}
2026-03-30 11:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB18656') HTTP/1.1" 204 0
2026-03-30 11:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS84685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.551(s), this was the 1st time calling it.
2026-03-30 11:40:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.3091727660488655 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU19337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK57553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW96115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:40:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:40:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.366(s), this was the 1st time calling it.
2026-03-30 11:40:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.809981973056008 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.130(s), this was the 2nd time calling it.
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.5939110688008573 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV94819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:41:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.092(s), this was the 1st time calling it.
2026-03-30 11:41:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.679071461673622 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH31708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:07 [scrapy.extensions.logstats] INFO: Crawled 165 pages (at 12 pages/min), scraped 102 items (at 4 items/min)
2026-03-30 11:41:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 11:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN29378> (referer: https://www.auto1.com/v1/car-details-view/RN29378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea32689-ebfe-5ed1-a394-0990d8871437 with identifier: RN29378
2026-03-30 11:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea32689-ebfe-5ed1-a394-0990d8871437 with scrape type 1
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_fb8631a0e3e42f2f0799c77f0b72ec32.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_fb8631a0e3e42f2f0799c77f0b72ec32.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_3e684091521420e6e8f18cd31255b023.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_3e684091521420e6e8f18cd31255b023.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_73b2295fb57128ddc0151126dfd66da8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_73b2295fb57128ddc0151126dfd66da8.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_8a66174c807879a6ecfc219ef619b008.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8a66174c807879a6ecfc219ef619b008.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_b7b32dc0864504abd2b70287f8fe71cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_b7b32dc0864504abd2b70287f8fe71cb.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_8270bffdfa1ae3f1655a293778a2deac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8270bffdfa1ae3f1655a293778a2deac.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_ced10c9f1077553443e1df4b5ff3566a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ced10c9f1077553443e1df4b5ff3566a.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_92c3400384ac29b937deb2e78df22e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_92c3400384ac29b937deb2e78df22e79.jpg not downloaded yet
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_09475dc28fd09df5145238ade5bb01ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_09475dc28fd09df5145238ade5bb01ee.jpg not downloaded yet
2026-03-30 11:41:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.775(s), this was the 2nd time calling it.
2026-03-30 11:41:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.196077362778071 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW90650> (referer: https://www.auto1.com/v1/car-details-view/WW90650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8faed8-fb0f-5814-a920-e811d349f49b with identifier: WW90650
2026-03-30 11:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8faed8-fb0f-5814-a920-e811d349f49b with scrape type 1
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa8faed8-fb0f-5814-a920-e811d349f49b
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_f57a572c14c565e1a141441948d504cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_f57a572c14c565e1a141441948d504cd.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_d86ed86aa4c98c7a48c82bd80346a08b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_d86ed86aa4c98c7a48c82bd80346a08b.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_b31c7c7a6856d04f75b223cc0821189e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_b31c7c7a6856d04f75b223cc0821189e.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_54468cf2bb99b8d94d094ffdee5c02dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_54468cf2bb99b8d94d094ffdee5c02dc.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_f60107ac97e5d76fc54771e507c9be5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_f60107ac97e5d76fc54771e507c9be5b.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_a292e61683397a7b9ff86b0fd687188c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_a292e61683397a7b9ff86b0fd687188c.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_710cb8344ab146fbd3e606bad420b9f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_710cb8344ab146fbd3e606bad420b9f9.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_c78477c3f2311ffddec3afbd5ae19f75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_c78477c3f2311ffddec3afbd5ae19f75.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_5692487bf1caf8a51df543d1acb70830.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_5692487bf1caf8a51df543d1acb70830.jpg already downloaded
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fb3%252F52b369478bf3afedc5859ce9e7c0156f%252Fpa%252FWW90650_c42ea8432aa9e161da3a3e76acbd5c28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_c42ea8432aa9e161da3a3e76acbd5c28.jpg already downloaded
2026-03-30 11:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa8faed8-fb0f-5814-a920-e811d349f49b, identifier: WW90650
2026-03-30 11:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa8faed8-fb0f-5814-a920-e811d349f49b with identifier: WW90650
2026-03-30 11:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa8faed8-fb0f-5814-a920-e811d349f49b with identifier: WW90650
2026-03-30 11:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa8faed8-fb0f-5814-a920-e811d349f49b with identifier: WW90650 to the API
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW90650>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:06:03Z',
 'fuel_type': 'diesel',
 'id': 'fa8faed8-fb0f-5814-a920-e811d349f49b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW90650',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 141756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_f57a572c14c565e1a141441948d504cd.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_d86ed86aa4c98c7a48c82bd80346a08b.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_b31c7c7a6856d04f75b223cc0821189e.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_54468cf2bb99b8d94d094ffdee5c02dc.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_f60107ac97e5d76fc54771e507c9be5b.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_a292e61683397a7b9ff86b0fd687188c.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_710cb8344ab146fbd3e606bad420b9f9.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_c78477c3f2311ffddec3afbd5ae19f75.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_5692487bf1caf8a51df543d1acb70830.jpg',
                'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_c42ea8432aa9e161da3a3e76acbd5c28.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3693305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_f57a572c14c565e1a141441948d504cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_d86ed86aa4c98c7a48c82bd80346a08b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3314670,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_b31c7c7a6856d04f75b223cc0821189e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_54468cf2bb99b8d94d094ffdee5c02dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3046327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_f60107ac97e5d76fc54771e507c9be5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_a292e61683397a7b9ff86b0fd687188c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_710cb8344ab146fbd3e606bad420b9f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3015108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_c78477c3f2311ffddec3afbd5ae19f75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_5692487bf1caf8a51df543d1acb70830.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8faed8-fb0f-5814-a920-e811d349f49b/fa8faed8-fb0f-5814-a920-e811d349f49b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2347451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/b3/52b369478bf3afedc5859ce9e7c0156f/pa/WW90650_c42ea8432aa9e161da3a3e76acbd5c28.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW90650%27 HTTP/1.1" 200 None
2026-03-30 11:41:16 [auto1.be] INFO: Saving data for WW90650: {'created_time': 1774870876.833038, 'last_price_update_time': 1774870876.833052, 'auction_closing_time': 1774969563.0}
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW90650') HTTP/1.1" 204 0
2026-03-30 11:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_09475dc28fd09df5145238ade5bb01ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a51d0>
2026-03-30 11:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_09475dc28fd09df5145238ade5bb01ee.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_09475dc28fd09df5145238ade5bb01ee.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_92c3400384ac29b937deb2e78df22e79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97dedd0>
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_92c3400384ac29b937deb2e78df22e79.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_92c3400384ac29b937deb2e78df22e79.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ced10c9f1077553443e1df4b5ff3566a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0f5650>
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_ced10c9f1077553443e1df4b5ff3566a.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ced10c9f1077553443e1df4b5ff3566a.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8270bffdfa1ae3f1655a293778a2deac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e6450>
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_8270bffdfa1ae3f1655a293778a2deac.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8270bffdfa1ae3f1655a293778a2deac.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_b7b32dc0864504abd2b70287f8fe71cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebfeda10>
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_b7b32dc0864504abd2b70287f8fe71cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_b7b32dc0864504abd2b70287f8fe71cb.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8a66174c807879a6ecfc219ef619b008.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_73b2295fb57128ddc0151126dfd66da8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a6050>
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_8a66174c807879a6ecfc219ef619b008.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8a66174c807879a6ecfc219ef619b008.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e1290>
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_73b2295fb57128ddc0151126dfd66da8.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_73b2295fb57128ddc0151126dfd66da8.jpg saved to cache
2026-03-30 11:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_3e684091521420e6e8f18cd31255b023.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a6890>
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_3e684091521420e6e8f18cd31255b023.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_3e684091521420e6e8f18cd31255b023.jpg saved to cache
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_fb8631a0e3e42f2f0799c77f0b72ec32.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e979de90>
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_fb8631a0e3e42f2f0799c77f0b72ec32.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_fb8631a0e3e42f2f0799c77f0b72ec32.jpg saved to cache
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d8f90>
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fa6%252F8aa63ac4790e7404b8a5c3a3d32a6d19%252Fpa%252FRN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg saved to cache
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ea32689-ebfe-5ed1-a394-0990d8871437
2026-03-30 11:41:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ea32689-ebfe-5ed1-a394-0990d8871437, skipping ID generation
2026-03-30 11:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea32689-ebfe-5ed1-a394-0990d8871437 with scrape type 1
2026-03-30 11:41:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ea32689-ebfe-5ed1-a394-0990d8871437 sending to next pipeline
2026-03-30 11:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ea32689-ebfe-5ed1-a394-0990d8871437, identifier: RN29378
2026-03-30 11:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ea32689-ebfe-5ed1-a394-0990d8871437 with identifier: RN29378
2026-03-30 11:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ea32689-ebfe-5ed1-a394-0990d8871437 with identifier: RN29378
2026-03-30 11:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ea32689-ebfe-5ed1-a394-0990d8871437 with identifier: RN29378 to the API
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:54Z',
 'fuel_type': 'petrol',
 'id': '8ea32689-ebfe-5ed1-a394-0990d8871437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN29378',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 67819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ff0806f6c816bf5def0c0171d9d420d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_fb8631a0e3e42f2f0799c77f0b72ec32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_3e684091521420e6e8f18cd31255b023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_73b2295fb57128ddc0151126dfd66da8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8a66174c807879a6ecfc219ef619b008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_b7b32dc0864504abd2b70287f8fe71cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_8270bffdfa1ae3f1655a293778a2deac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_ced10c9f1077553443e1df4b5ff3566a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_92c3400384ac29b937deb2e78df22e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ea32689-ebfe-5ed1-a394-0990d8871437/8ea32689-ebfe-5ed1-a394-0990d8871437_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/a6/8aa63ac4790e7404b8a5c3a3d32a6d19/pa/RN29378_09475dc28fd09df5145238ade5bb01ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN29378%27 HTTP/1.1" 200 None
2026-03-30 11:41:18 [auto1.be] INFO: Saving data for RN29378: {'created_time': 1774870878.861397, 'last_price_update_time': 1774870878.861411, 'auction_closing_time': 1774972014.0}
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RN29378') HTTP/1.1" 204 0
2026-03-30 11:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:41:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:41:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:41:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:41:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97d1310>
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F7c%252F1d7cdc8f0e9867313e0e6ec27d0afff2%252Fpa%252FGY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg saved to cache
2026-03-30 11:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d
2026-03-30 11:41:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4410ab50-b3ae-5365-bee6-516ffe7d4a4d, skipping ID generation
2026-03-30 11:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d with scrape type 1
2026-03-30 11:41:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4410ab50-b3ae-5365-bee6-516ffe7d4a4d sending to next pipeline
2026-03-30 11:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4410ab50-b3ae-5365-bee6-516ffe7d4a4d, identifier: GY85550
2026-03-30 11:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4410ab50-b3ae-5365-bee6-516ffe7d4a4d with identifier: GY85550
2026-03-30 11:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4410ab50-b3ae-5365-bee6-516ffe7d4a4d with identifier: GY85550
2026-03-30 11:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4410ab50-b3ae-5365-bee6-516ffe7d4a4d with identifier: GY85550 to the API
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:02Z',
 'fuel_type': 'petrol',
 'id': '4410ab50-b3ae-5365-bee6-516ffe7d4a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY85550',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 164270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3542820,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_5a7f0b4105540f196fcb322a5c3cdf4d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_dcfe2cf9435de997d18526d28c64e8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_4d12d2bccab84634f988cd4c3bc144d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_88d058c276349bbb89c3f538c75e7148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ecbdd6180209848a630b6ab55a39d8a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2894776ead3fc4cbfdc9c60ef0473679.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_b01203fd4d46d71eccc909dfc54a963c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_ac41f50a324ca2bf930576f6f296386b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_776e600091d955eba9ef192007faec1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4410ab50-b3ae-5365-bee6-516ffe7d4a4d/4410ab50-b3ae-5365-bee6-516ffe7d4a4d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/7c/1d7cdc8f0e9867313e0e6ec27d0afff2/pa/GY85550_2cd747c91a8d407608939622e3b4a5e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.4 TFSI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2014}
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GY85550%27 HTTP/1.1" 200 None
2026-03-30 11:41:19 [auto1.be] INFO: Saving data for GY85550: {'created_time': 1774870879.680012, 'last_price_update_time': 1774870879.680022, 'auction_closing_time': 1774970042.0}
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GY85550') HTTP/1.1" 204 0
2026-03-30 11:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_b1be8bc48012c09d67b3c857443bb255.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_886372c58c0afbc3a93abc742412b11b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:36 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1758 | hits on page: 40
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: FH32822
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH32822%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for FH32822: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: LB99980
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB99980%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for LB99980: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: GS30663
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS30663%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for GS30663: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: YE48599
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: XY44449
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY44449%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for XY44449: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: JT22008
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT22008%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for JT22008: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: KN48892
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: EM93050
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM93050%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for EM93050: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for HJ61714: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for FA19213: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: GC80115
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC80115%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for GC80115: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: GL14353
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: NH22682
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: WR44467
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR44467%27 HTTP/1.1" 200 None
2026-03-30 11:41:36 [auto1.be] INFO: Scrape type for WR44467: 0
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: FH77078
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-30 11:41:36 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-30 11:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for NB29078: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for PD78607: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: RH39924
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH39924%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for RH39924: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: EP05559
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP05559%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for EP05559: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: ML39304
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: XV08295
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: CY95631
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY95631%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for CY95631: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: UF38996
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF38996%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for UF38996: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for TZ53898: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Scrape type for PS28625: 0
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: MS84357
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: MD91238
2026-03-30 11:41:37 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-30 11:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_ae579c156fba6835f8c9030e17c16db8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec3b1dd0>
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_b1be8bc48012c09d67b3c857443bb255.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_b1be8bc48012c09d67b3c857443bb255.jpg saved to cache
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e5b90>
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_886372c58c0afbc3a93abc742412b11b.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_886372c58c0afbc3a93abc742412b11b.jpg saved to cache
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9743f10>
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F44%252Fb344099af304b0ff1232babb36632e9e%252Fpa%252FPA62329_ae579c156fba6835f8c9030e17c16db8.jpg') HTTP/1.1" 204 0
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_ae579c156fba6835f8c9030e17c16db8.jpg saved to cache
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 062cc19f-5ceb-536c-9daa-2eb49b706c88
2026-03-30 11:41:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 062cc19f-5ceb-536c-9daa-2eb49b706c88, skipping ID generation
2026-03-30 11:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062cc19f-5ceb-536c-9daa-2eb49b706c88 with scrape type 1
2026-03-30 11:41:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 062cc19f-5ceb-536c-9daa-2eb49b706c88 sending to next pipeline
2026-03-30 11:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 062cc19f-5ceb-536c-9daa-2eb49b706c88, identifier: PA62329
2026-03-30 11:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 062cc19f-5ceb-536c-9daa-2eb49b706c88 with identifier: PA62329
2026-03-30 11:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 062cc19f-5ceb-536c-9daa-2eb49b706c88 with identifier: PA62329
2026-03-30 11:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 062cc19f-5ceb-536c-9daa-2eb49b706c88 with identifier: PA62329 to the API
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_ae579c156fba6835f8c9030e17c16db8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:04:35Z',
 'fuel_type': 'petrol',
 'id': '062cc19f-5ceb-536c-9daa-2eb49b706c88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA62329',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 128840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_ae579c156fba6835f8c9030e17c16db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_886372c58c0afbc3a93abc742412b11b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_b1be8bc48012c09d67b3c857443bb255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_0f594084becf81de362f4b6c5524c063.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_22f4f92e29607a93c927c6bfa1c4af1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_9748a8670aebdf16fbd0dcf607aada9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_abc13e3efea78877548911e1c86b888b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_883c82f064a51efc937ad605b215761b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_e84efe35bb49c6d3ab74cc102024e9ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_062cc19f-5ceb-536c-9daa-2eb49b706c88/062cc19f-5ceb-536c-9daa-2eb49b706c88_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/44/b344099af304b0ff1232babb36632e9e/pa/PA62329_d60aa5815580d083dcec87c567ffd3d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 ITwingo',
 'transmission': 'manual',
 'trim': 'I',
 'year': 2012}
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA62329%27 HTTP/1.1" 200 None
2026-03-30 11:41:37 [auto1.be] INFO: Saving data for PA62329: {'created_time': 1774870897.74065, 'last_price_update_time': 1774870897.740663, 'auction_closing_time': 1774969475.0}
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PA62329') HTTP/1.1" 204 0
2026-03-30 11:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK03053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.683(s), this was the 1st time calling it.
2026-03-30 11:41:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.279650537750286 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU41998/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF72593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS84685> (referer: https://www.auto1.com/v1/car-details-view/PS84685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f86ee824-a0c0-5c9d-ad24-0405f430467c with identifier: PS84685
2026-03-30 11:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f86ee824-a0c0-5c9d-ad24-0405f430467c with scrape type 1
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f86ee824-a0c0-5c9d-ad24-0405f430467c
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_cb5f85216b1cf21a8e0f35e22c347a2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_cb5f85216b1cf21a8e0f35e22c347a2d.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_6fabbaaf856644377f5cd5e8a28d4d40.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_6fabbaaf856644377f5cd5e8a28d4d40.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_e0eab0c0dd54a455d6970096a480f115.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_e0eab0c0dd54a455d6970096a480f115.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_1277442a537ecb540fa83215e6e5d163.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_1277442a537ecb540fa83215e6e5d163.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_e664ebd542720fcfaccd3c682f98801a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_e664ebd542720fcfaccd3c682f98801a.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_c4048ded72fa0d42aa47ebd558549c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_c4048ded72fa0d42aa47ebd558549c07.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_c5bb1da3049dd042657fdd88b7f36ab6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_c5bb1da3049dd042657fdd88b7f36ab6.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_450fd9bc3323ad1320be54951221797f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_450fd9bc3323ad1320be54951221797f.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_3e5ac9ff625c9d592f1bba7da2ce09a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_3e5ac9ff625c9d592f1bba7da2ce09a8.jpg already downloaded
2026-03-30 11:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fa9%252Fc0a97e716ce5f6976d9195b5932c83ad%252Fpa%252FPS84685_784b5c8c293d4133a90a2efae8f663d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_784b5c8c293d4133a90a2efae8f663d0.jpg already downloaded
2026-03-30 11:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f86ee824-a0c0-5c9d-ad24-0405f430467c, identifier: PS84685
2026-03-30 11:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f86ee824-a0c0-5c9d-ad24-0405f430467c with identifier: PS84685
2026-03-30 11:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f86ee824-a0c0-5c9d-ad24-0405f430467c with identifier: PS84685
2026-03-30 11:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f86ee824-a0c0-5c9d-ad24-0405f430467c with identifier: PS84685 to the API
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS84685>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:24:01Z',
 'fuel_type': 'diesel',
 'id': 'f86ee824-a0c0-5c9d-ad24-0405f430467c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS84685',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 153219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_cb5f85216b1cf21a8e0f35e22c347a2d.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_6fabbaaf856644377f5cd5e8a28d4d40.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_e0eab0c0dd54a455d6970096a480f115.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_1277442a537ecb540fa83215e6e5d163.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_e664ebd542720fcfaccd3c682f98801a.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_c4048ded72fa0d42aa47ebd558549c07.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_c5bb1da3049dd042657fdd88b7f36ab6.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_450fd9bc3323ad1320be54951221797f.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_3e5ac9ff625c9d592f1bba7da2ce09a8.jpg',
                'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_784b5c8c293d4133a90a2efae8f663d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_cb5f85216b1cf21a8e0f35e22c347a2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_6fabbaaf856644377f5cd5e8a28d4d40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_e0eab0c0dd54a455d6970096a480f115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_1277442a537ecb540fa83215e6e5d163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_e664ebd542720fcfaccd3c682f98801a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_c4048ded72fa0d42aa47ebd558549c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_c5bb1da3049dd042657fdd88b7f36ab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_450fd9bc3323ad1320be54951221797f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_3e5ac9ff625c9d592f1bba7da2ce09a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f86ee824-a0c0-5c9d-ad24-0405f430467c/f86ee824-a0c0-5c9d-ad24-0405f430467c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/a9/c0a97e716ce5f6976d9195b5932c83ad/pa/PS84685_784b5c8c293d4133a90a2efae8f663d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS84685%27 HTTP/1.1" 200 None
2026-03-30 11:41:57 [auto1.be] INFO: Saving data for PS84685: {'created_time': 1774870917.528957, 'last_price_update_time': 1774870917.528968, 'auction_closing_time': 1774970641.0}
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS84685') HTTP/1.1" 204 0
2026-03-30 11:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW96115> (referer: https://www.auto1.com/v1/car-details-view/TW96115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abfd12d6-ff8b-54aa-909b-1382fa54d8ee with identifier: TW96115
2026-03-30 11:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abfd12d6-ff8b-54aa-909b-1382fa54d8ee with scrape type 1
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item abfd12d6-ff8b-54aa-909b-1382fa54d8ee
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_e562e1605a471cfc51391a5716276150.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_e562e1605a471cfc51391a5716276150.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_a877f6eea851c555019e9052d868b19e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_a877f6eea851c555019e9052d868b19e.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_55d2c6ad7428c8929ba1ea04e66d3bf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_55d2c6ad7428c8929ba1ea04e66d3bf1.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_45fe620ca9e6f9600f7e9ad9d8a06386.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_45fe620ca9e6f9600f7e9ad9d8a06386.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_3d0bd18553fd17927aec453e7e016cd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_3d0bd18553fd17927aec453e7e016cd0.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_9ac583b6584c107603904881464d9bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_9ac583b6584c107603904881464d9bad.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_ba51dd0082087f78d3593cb5dad06d4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_ba51dd0082087f78d3593cb5dad06d4b.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_6ae0c9923b10639b5bc5216f535278e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_6ae0c9923b10639b5bc5216f535278e2.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_b268f449e145717930261d9b32ff491d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_b268f449e145717930261d9b32ff491d.jpg already downloaded
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F7f%252Fd27f250243548b3a9d1c8c56253c85f3%252Fpa%252FTW96115_57dc70d00d5954d31eb3141a40b844c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_57dc70d00d5954d31eb3141a40b844c9.jpg already downloaded
2026-03-30 11:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: abfd12d6-ff8b-54aa-909b-1382fa54d8ee, identifier: TW96115
2026-03-30 11:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: abfd12d6-ff8b-54aa-909b-1382fa54d8ee with identifier: TW96115
2026-03-30 11:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: abfd12d6-ff8b-54aa-909b-1382fa54d8ee with identifier: TW96115
2026-03-30 11:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: abfd12d6-ff8b-54aa-909b-1382fa54d8ee with identifier: TW96115 to the API
2026-03-30 11:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW96115>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:17:43Z',
 'fuel_type': 'diesel',
 'id': 'abfd12d6-ff8b-54aa-909b-1382fa54d8ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW96115',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 120283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_e562e1605a471cfc51391a5716276150.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_a877f6eea851c555019e9052d868b19e.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_55d2c6ad7428c8929ba1ea04e66d3bf1.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_45fe620ca9e6f9600f7e9ad9d8a06386.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_3d0bd18553fd17927aec453e7e016cd0.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_9ac583b6584c107603904881464d9bad.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_ba51dd0082087f78d3593cb5dad06d4b.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_6ae0c9923b10639b5bc5216f535278e2.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_b268f449e145717930261d9b32ff491d.jpg',
                'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_57dc70d00d5954d31eb3141a40b844c9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_e562e1605a471cfc51391a5716276150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_a877f6eea851c555019e9052d868b19e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_55d2c6ad7428c8929ba1ea04e66d3bf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_45fe620ca9e6f9600f7e9ad9d8a06386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_3d0bd18553fd17927aec453e7e016cd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_9ac583b6584c107603904881464d9bad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_ba51dd0082087f78d3593cb5dad06d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_6ae0c9923b10639b5bc5216f535278e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_b268f449e145717930261d9b32ff491d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abfd12d6-ff8b-54aa-909b-1382fa54d8ee/abfd12d6-ff8b-54aa-909b-1382fa54d8ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/7f/d27f250243548b3a9d1c8c56253c85f3/pa/TW96115_57dc70d00d5954d31eb3141a40b844c9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 11:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW96115%27 HTTP/1.1" 200 None
2026-03-30 11:41:59 [auto1.be] INFO: Saving data for TW96115: {'created_time': 1774870919.464992, 'last_price_update_time': 1774870919.465003, 'auction_closing_time': 1774970263.0}
2026-03-30 11:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW96115') HTTP/1.1" 204 0
2026-03-30 11:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV94819> (referer: https://www.auto1.com/v1/car-details-view/YV94819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30eee2bb-18d4-5318-a5cf-93e9e17062cf with identifier: YV94819
2026-03-30 11:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf with scrape type 1
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_24061b8dc8bcf7072dfb602dd9b7077b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_24061b8dc8bcf7072dfb602dd9b7077b.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_21b2c851cd82a85ed3716f00e6e9254a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_21b2c851cd82a85ed3716f00e6e9254a.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_df931a68a2898b86547226508d25e5ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_df931a68a2898b86547226508d25e5ce.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_15cf23b0d140f2aa6613c409ea09ae61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_15cf23b0d140f2aa6613c409ea09ae61.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_66fc5074b518adab29d7f6a53ea5aad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_66fc5074b518adab29d7f6a53ea5aad8.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_0da4e4d47f89a4d02c5444adf4ed93d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_0da4e4d47f89a4d02c5444adf4ed93d1.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_04a270ac316182e54df2f02e00a2df79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_04a270ac316182e54df2f02e00a2df79.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_e860b0dc568b2bcfe2c1da1d0dd7d527.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_e860b0dc568b2bcfe2c1da1d0dd7d527.jpg not downloaded yet
2026-03-30 11:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_ac949c18de941a5786d7003a4ed63a8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_ac949c18de941a5786d7003a4ed63a8c.jpg not downloaded yet
2026-03-30 11:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH31708> (referer: https://www.auto1.com/v1/car-details-view/GH31708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85be126-b0cb-5f6e-9349-c8066e5cd86e with identifier: GH31708
2026-03-30 11:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85be126-b0cb-5f6e-9349-c8066e5cd86e with scrape type 1
2026-03-30 11:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg not downloaded yet
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_246812c596f3ae95f51de53ed56cf0b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_246812c596f3ae95f51de53ed56cf0b1.jpg not downloaded yet
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_f03f18f092d55b9da1b356752eb99ea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_f03f18f092d55b9da1b356752eb99ea9.jpg not downloaded yet
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_6b7fadcda927cafa511345af62539217.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_6b7fadcda927cafa511345af62539217.jpg not downloaded yet
2026-03-30 11:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_2f388622ccb7fa0cb94027f638a8a0e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_2f388622ccb7fa0cb94027f638a8a0e9.jpg not downloaded yet
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_34dd1bc6c454d01bc586ab4445cbe40a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_34dd1bc6c454d01bc586ab4445cbe40a.jpg not downloaded yet
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_d38b69daf05ea51fcab5833f31bf6277.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_d38b69daf05ea51fcab5833f31bf6277.jpg not downloaded yet
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_a63af8f717611d07e9b8e5312add978f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_a63af8f717611d07e9b8e5312add978f.jpg not downloaded yet
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_65219c97c17851018dea18c7d04e8777.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_65219c97c17851018dea18c7d04e8777.jpg not downloaded yet
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_37053c9613a9337815cfb39721db0fb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_37053c9613a9337815cfb39721db0fb6.jpg not downloaded yet
2026-03-30 11:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_ac949c18de941a5786d7003a4ed63a8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec013850>
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_ac949c18de941a5786d7003a4ed63a8c.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_ac949c18de941a5786d7003a4ed63a8c.jpg saved to cache
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_37053c9613a9337815cfb39721db0fb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea219890>
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_37053c9613a9337815cfb39721db0fb6.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_37053c9613a9337815cfb39721db0fb6.jpg saved to cache
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_65219c97c17851018dea18c7d04e8777.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9884250>
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_65219c97c17851018dea18c7d04e8777.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_65219c97c17851018dea18c7d04e8777.jpg saved to cache
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_a63af8f717611d07e9b8e5312add978f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9832390>
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_a63af8f717611d07e9b8e5312add978f.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_a63af8f717611d07e9b8e5312add978f.jpg saved to cache
2026-03-30 11:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_d38b69daf05ea51fcab5833f31bf6277.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12fb10>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_d38b69daf05ea51fcab5833f31bf6277.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_d38b69daf05ea51fcab5833f31bf6277.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_34dd1bc6c454d01bc586ab4445cbe40a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea117650>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_34dd1bc6c454d01bc586ab4445cbe40a.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_34dd1bc6c454d01bc586ab4445cbe40a.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_2f388622ccb7fa0cb94027f638a8a0e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea12fc10>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_2f388622ccb7fa0cb94027f638a8a0e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_2f388622ccb7fa0cb94027f638a8a0e9.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_6b7fadcda927cafa511345af62539217.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_f03f18f092d55b9da1b356752eb99ea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96d8f10>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_6b7fadcda927cafa511345af62539217.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_6b7fadcda927cafa511345af62539217.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9832710>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_f03f18f092d55b9da1b356752eb99ea9.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_f03f18f092d55b9da1b356752eb99ea9.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_246812c596f3ae95f51de53ed56cf0b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e2d90>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_246812c596f3ae95f51de53ed56cf0b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_246812c596f3ae95f51de53ed56cf0b1.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9822bd0>
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F3b%252F8d3b1bc430ec9a3295ef646866fbf840%252Fpa%252FGH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg saved to cache
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f85be126-b0cb-5f6e-9349-c8066e5cd86e
2026-03-30 11:42:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f85be126-b0cb-5f6e-9349-c8066e5cd86e, skipping ID generation
2026-03-30 11:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85be126-b0cb-5f6e-9349-c8066e5cd86e with scrape type 1
2026-03-30 11:42:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f85be126-b0cb-5f6e-9349-c8066e5cd86e sending to next pipeline
2026-03-30 11:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f85be126-b0cb-5f6e-9349-c8066e5cd86e, identifier: GH31708
2026-03-30 11:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f85be126-b0cb-5f6e-9349-c8066e5cd86e with identifier: GH31708
2026-03-30 11:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f85be126-b0cb-5f6e-9349-c8066e5cd86e with identifier: GH31708
2026-03-30 11:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f85be126-b0cb-5f6e-9349-c8066e5cd86e with identifier: GH31708 to the API
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:51:52Z',
 'fuel_type': 'petrol',
 'id': 'f85be126-b0cb-5f6e-9349-c8066e5cd86e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH31708',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 51640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_b417cb00a6f3c75fbfa8653d0f4c82bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_246812c596f3ae95f51de53ed56cf0b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_f03f18f092d55b9da1b356752eb99ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_6b7fadcda927cafa511345af62539217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_2f388622ccb7fa0cb94027f638a8a0e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_34dd1bc6c454d01bc586ab4445cbe40a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_d38b69daf05ea51fcab5833f31bf6277.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_a63af8f717611d07e9b8e5312add978f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_65219c97c17851018dea18c7d04e8777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f85be126-b0cb-5f6e-9349-c8066e5cd86e/f85be126-b0cb-5f6e-9349-c8066e5cd86e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/3b/8d3b1bc430ec9a3295ef646866fbf840/pa/GH31708_37053c9613a9337815cfb39721db0fb6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH31708%27 HTTP/1.1" 200 None
2026-03-30 11:42:04 [auto1.be] INFO: Saving data for GH31708: {'created_time': 1774870924.299112, 'last_price_update_time': 1774870924.299123, 'auction_closing_time': 1774972312.0}
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH31708') HTTP/1.1" 204 0
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL36381/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_e860b0dc568b2bcfe2c1da1d0dd7d527.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e3b10>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_e860b0dc568b2bcfe2c1da1d0dd7d527.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_e860b0dc568b2bcfe2c1da1d0dd7d527.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_0da4e4d47f89a4d02c5444adf4ed93d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_04a270ac316182e54df2f02e00a2df79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1006d0>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_0da4e4d47f89a4d02c5444adf4ed93d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_0da4e4d47f89a4d02c5444adf4ed93d1.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2cd550>
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_04a270ac316182e54df2f02e00a2df79.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_04a270ac316182e54df2f02e00a2df79.jpg saved to cache
2026-03-30 11:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_66fc5074b518adab29d7f6a53ea5aad8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_15cf23b0d140f2aa6613c409ea09ae61.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea102950>
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_66fc5074b518adab29d7f6a53ea5aad8.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_66fc5074b518adab29d7f6a53ea5aad8.jpg saved to cache
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU19337> (referer: https://www.auto1.com/v1/car-details-view/AU19337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebfad210>
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_15cf23b0d140f2aa6613c409ea09ae61.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_15cf23b0d140f2aa6613c409ea09ae61.jpg saved to cache
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c740822a-a26a-5c74-958a-3983b114b0ae with identifier: AU19337
2026-03-30 11:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c740822a-a26a-5c74-958a-3983b114b0ae with scrape type 1
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_948dac6f5bbc0b555103114d729a4f42.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_948dac6f5bbc0b555103114d729a4f42.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_a1f4e79b53da6b983921991bb8742a81.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a1f4e79b53da6b983921991bb8742a81.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_9818fac29fe50f475c1789aafb2ef48c.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_9818fac29fe50f475c1789aafb2ef48c.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_b4e7a4f487754a181262ff558847c307.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_b4e7a4f487754a181262ff558847c307.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_a12db39bcc90e1ecaf1db26fbc6fdce2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a12db39bcc90e1ecaf1db26fbc6fdce2.jpg not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_8931aec2617eb995237b255ca2f2b795.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_8931aec2617eb995237b255ca2f2b795.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_e875bd21bbf53dee26594aada44ff0a6.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_e875bd21bbf53dee26594aada44ff0a6.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_0e063707a37ae43aeebc36403b157d41.png%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0e063707a37ae43aeebc36403b157d41.png not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_0222b0c25adf1c40c54111d856d7490f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0222b0c25adf1c40c54111d856d7490f.jpg not downloaded yet
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_dada7ccf98ef4182c9f1c825703612aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_dada7ccf98ef4182c9f1c825703612aa.jpg not downloaded yet
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_21b2c851cd82a85ed3716f00e6e9254a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_dada7ccf98ef4182c9f1c825703612aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0222b0c25adf1c40c54111d856d7490f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_df931a68a2898b86547226508d25e5ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea1140d0>
2026-03-30 11:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_21b2c851cd82a85ed3716f00e6e9254a.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_21b2c851cd82a85ed3716f00e6e9254a.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0e063707a37ae43aeebc36403b157d41.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e6e10>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_dada7ccf98ef4182c9f1c825703612aa.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_dada7ccf98ef4182c9f1c825703612aa.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fabd0>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_0222b0c25adf1c40c54111d856d7490f.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0222b0c25adf1c40c54111d856d7490f.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0bcf90>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_df931a68a2898b86547226508d25e5ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_df931a68a2898b86547226508d25e5ce.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7f97526d0>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_7.png HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_0e063707a37ae43aeebc36403b157d41.png') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0e063707a37ae43aeebc36403b157d41.png saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_e875bd21bbf53dee26594aada44ff0a6.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_8931aec2617eb995237b255ca2f2b795.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98420d0>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_6.png HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_e875bd21bbf53dee26594aada44ff0a6.png') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_e875bd21bbf53dee26594aada44ff0a6.png saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a12db39bcc90e1ecaf1db26fbc6fdce2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97ba410>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_5.png HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_8931aec2617eb995237b255ca2f2b795.png') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_8931aec2617eb995237b255ca2f2b795.png saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_b4e7a4f487754a181262ff558847c307.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2f4510>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_a12db39bcc90e1ecaf1db26fbc6fdce2.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a12db39bcc90e1ecaf1db26fbc6fdce2.jpg saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a1f4e79b53da6b983921991bb8742a81.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_9818fac29fe50f475c1789aafb2ef48c.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0f4410>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_3.png HTTP/1.1" 201 0
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_b4e7a4f487754a181262ff558847c307.png') HTTP/1.1" 204 0
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_b4e7a4f487754a181262ff558847c307.png saved to cache
2026-03-30 11:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:06 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96c3b10>
2026-03-30 11:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_1.png HTTP/1.1" 201 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_a1f4e79b53da6b983921991bb8742a81.png') HTTP/1.1" 204 0
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a1f4e79b53da6b983921991bb8742a81.png saved to cache
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea218cd0>
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_2.png HTTP/1.1" 201 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_9818fac29fe50f475c1789aafb2ef48c.png') HTTP/1.1" 204 0
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_9818fac29fe50f475c1789aafb2ef48c.png saved to cache
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:07 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 12 pages/min), scraped 109 items (at 7 items/min)
2026-03-30 11:42:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 173MiB
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_948dac6f5bbc0b555103114d729a4f42.png> (referer: https://www.auto1.com/)
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_24061b8dc8bcf7072dfb602dd9b7077b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:42:07 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:42:07 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaeea450>
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_0.png HTTP/1.1" 201 0
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F05%252F4c053fe40eba066a1a4f2e0dc9086605%252Fpa%252FAU19337_948dac6f5bbc0b555103114d729a4f42.png') HTTP/1.1" 204 0
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_948dac6f5bbc0b555103114d729a4f42.png saved to cache
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c740822a-a26a-5c74-958a-3983b114b0ae
2026-03-30 11:42:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c740822a-a26a-5c74-958a-3983b114b0ae, skipping ID generation
2026-03-30 11:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c740822a-a26a-5c74-958a-3983b114b0ae with scrape type 1
2026-03-30 11:42:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c740822a-a26a-5c74-958a-3983b114b0ae sending to next pipeline
2026-03-30 11:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c740822a-a26a-5c74-958a-3983b114b0ae, identifier: AU19337
2026-03-30 11:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c740822a-a26a-5c74-958a-3983b114b0ae with identifier: AU19337
2026-03-30 11:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c740822a-a26a-5c74-958a-3983b114b0ae with identifier: AU19337
2026-03-30 11:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c740822a-a26a-5c74-958a-3983b114b0ae with identifier: AU19337 to the API
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_948dac6f5bbc0b555103114d729a4f42.png>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:04:59Z',
 'fuel_type': 'diesel',
 'id': 'c740822a-a26a-5c74-958a-3983b114b0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU19337',
 'listing': 'auction',
 'location': 'BE, Tongeren',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 16993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 966732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_948dac6f5bbc0b555103114d729a4f42.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 966732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a1f4e79b53da6b983921991bb8742a81.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 754541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_9818fac29fe50f475c1789aafb2ef48c.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 754541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_b4e7a4f487754a181262ff558847c307.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_a12db39bcc90e1ecaf1db26fbc6fdce2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 993478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_8931aec2617eb995237b255ca2f2b795.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 993478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_e875bd21bbf53dee26594aada44ff0a6.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 993478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0e063707a37ae43aeebc36403b157d41.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_0222b0c25adf1c40c54111d856d7490f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c740822a-a26a-5c74-958a-3983b114b0ae/c740822a-a26a-5c74-958a-3983b114b0ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/05/4c053fe40eba066a1a4f2e0dc9086605/pa/AU19337_dada7ccf98ef4182c9f1c825703612aa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi',
 'transmission': 'manual',
 'trim': 'Maxi',
 'year': 2025}
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU19337%27 HTTP/1.1" 200 None
2026-03-30 11:42:07 [auto1.be] INFO: Saving data for AU19337: {'created_time': 1774870927.960953, 'last_price_update_time': 1774870927.960967, 'auction_closing_time': 1774969499.0}
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU19337') HTTP/1.1" 204 0
2026-03-30 11:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV12777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b9010>
2026-03-30 11:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_24061b8dc8bcf7072dfb602dd9b7077b.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_24061b8dc8bcf7072dfb602dd9b7077b.jpg saved to cache
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0e4b90>
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F6f%252Fc56f5ac03402fd3a6db8777de3fd90a8%252Fpa%252FYV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg saved to cache
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf
2026-03-30 11:42:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30eee2bb-18d4-5318-a5cf-93e9e17062cf, skipping ID generation
2026-03-30 11:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf with scrape type 1
2026-03-30 11:42:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30eee2bb-18d4-5318-a5cf-93e9e17062cf sending to next pipeline
2026-03-30 11:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30eee2bb-18d4-5318-a5cf-93e9e17062cf, identifier: YV94819
2026-03-30 11:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30eee2bb-18d4-5318-a5cf-93e9e17062cf with identifier: YV94819
2026-03-30 11:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30eee2bb-18d4-5318-a5cf-93e9e17062cf with identifier: YV94819
2026-03-30 11:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30eee2bb-18d4-5318-a5cf-93e9e17062cf with identifier: YV94819 to the API
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:43:37Z',
 'fuel_type': 'diesel',
 'id': '30eee2bb-18d4-5318-a5cf-93e9e17062cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV94819',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Ford',
 'model': 'Tourneo Connect',
 'odometer': 55490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_28363c45af58b6b6dc2c38e11b8f56a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_24061b8dc8bcf7072dfb602dd9b7077b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_21b2c851cd82a85ed3716f00e6e9254a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_df931a68a2898b86547226508d25e5ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_15cf23b0d140f2aa6613c409ea09ae61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2914583,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_66fc5074b518adab29d7f6a53ea5aad8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_0da4e4d47f89a4d02c5444adf4ed93d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_04a270ac316182e54df2f02e00a2df79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_e860b0dc568b2bcfe2c1da1d0dd7d527.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eee2bb-18d4-5318-a5cf-93e9e17062cf/30eee2bb-18d4-5318-a5cf-93e9e17062cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008548,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/6f/c56f5ac03402fd3a6db8777de3fd90a8/pa/YV94819_ac949c18de941a5786d7003a4ed63a8c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Connect 1.5 TDCi Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV94819%27 HTTP/1.1" 200 None
2026-03-30 11:42:08 [auto1.be] INFO: Saving data for YV94819: {'created_time': 1774870928.787812, 'last_price_update_time': 1774870928.787827, 'auction_closing_time': 1774971817.0}
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV94819') HTTP/1.1" 204 0
2026-03-30 11:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK03053> (referer: https://www.auto1.com/v1/car-details-view/FK03053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fd26e22-e0af-5084-a0be-c747d89d9562 with identifier: FK03053
2026-03-30 11:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fd26e22-e0af-5084-a0be-c747d89d9562 with scrape type 1
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fd26e22-e0af-5084-a0be-c747d89d9562
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_112820ff55cb14cf85c4822e86cfb02f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_112820ff55cb14cf85c4822e86cfb02f.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_a2d0e7e6c89d1793f351ebfb1f20e6bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_a2d0e7e6c89d1793f351ebfb1f20e6bb.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_6eb4da389ccf8e5540aebe28d6db4670.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_6eb4da389ccf8e5540aebe28d6db4670.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_abb1b7655ee6a20e7753d3734a61e9c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_abb1b7655ee6a20e7753d3734a61e9c9.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_cc0ff3a4977ba3db27bd739fe5e892ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_cc0ff3a4977ba3db27bd739fe5e892ca.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_d06600bf8f95834371508bbd2529c86d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_d06600bf8f95834371508bbd2529c86d.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_2e43f031b7e888e611fa41e28c83a6b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_2e43f031b7e888e611fa41e28c83a6b3.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_988310a539a296d2060126c283f2a113.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_988310a539a296d2060126c283f2a113.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_d968c7b6e31629a8e6262217b7c732dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_d968c7b6e31629a8e6262217b7c732dd.jpg already downloaded
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb6%252F5eb6a34fb566413c985472a25d9a3503%252Fpa%252FFK03053_1db889f4711387473c23bd8e4249177c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_1db889f4711387473c23bd8e4249177c.jpg already downloaded
2026-03-30 11:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9fd26e22-e0af-5084-a0be-c747d89d9562, identifier: FK03053
2026-03-30 11:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9fd26e22-e0af-5084-a0be-c747d89d9562 with identifier: FK03053
2026-03-30 11:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9fd26e22-e0af-5084-a0be-c747d89d9562 with identifier: FK03053
2026-03-30 11:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9fd26e22-e0af-5084-a0be-c747d89d9562 with identifier: FK03053 to the API
2026-03-30 11:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK03053>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:35:36Z',
 'fuel_type': 'diesel',
 'id': '9fd26e22-e0af-5084-a0be-c747d89d9562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK03053',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 143215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_112820ff55cb14cf85c4822e86cfb02f.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_a2d0e7e6c89d1793f351ebfb1f20e6bb.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_6eb4da389ccf8e5540aebe28d6db4670.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_abb1b7655ee6a20e7753d3734a61e9c9.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_cc0ff3a4977ba3db27bd739fe5e892ca.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_d06600bf8f95834371508bbd2529c86d.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_2e43f031b7e888e611fa41e28c83a6b3.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_988310a539a296d2060126c283f2a113.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_d968c7b6e31629a8e6262217b7c732dd.jpg',
                'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_1db889f4711387473c23bd8e4249177c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3647371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_112820ff55cb14cf85c4822e86cfb02f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_a2d0e7e6c89d1793f351ebfb1f20e6bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_6eb4da389ccf8e5540aebe28d6db4670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_abb1b7655ee6a20e7753d3734a61e9c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3585491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_cc0ff3a4977ba3db27bd739fe5e892ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_d06600bf8f95834371508bbd2529c86d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_2e43f031b7e888e611fa41e28c83a6b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_988310a539a296d2060126c283f2a113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3553795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_d968c7b6e31629a8e6262217b7c732dd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fd26e22-e0af-5084-a0be-c747d89d9562/9fd26e22-e0af-5084-a0be-c747d89d9562_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b6/5eb6a34fb566413c985472a25d9a3503/pa/FK03053_1db889f4711387473c23bd8e4249177c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2014}
2026-03-30 11:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK03053%27 HTTP/1.1" 200 None
2026-03-30 11:42:10 [auto1.be] INFO: Saving data for FK03053: {'created_time': 1774870930.472756, 'last_price_update_time': 1774870930.472768, 'auction_closing_time': 1774971336.0}
2026-03-30 11:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK03053') HTTP/1.1" 204 0
2026-03-30 11:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV96018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:35 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1758 | hits on page: 40
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: XC26287
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC26287%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for XC26287: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for EL40372: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: YX69957
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: GS42296
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for PM47313: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: XV45416
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV45416%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for XV45416: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for UE43146: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: HL05710
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: NH80895
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for SD69002: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: GX79489
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX79489%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for GX79489: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for WW33850: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: AU97754
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU97754%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for AU97754: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: AH26966
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH26966%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for AH26966: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: YU57960
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU57960%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for YU57960: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: GD38693
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for KD01441: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: PH52818
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: DA58595
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: PL94274
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for ZX58483: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: MX38879
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: PK81975
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK81975%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for PK81975: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: JJ16156
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ16156%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for JJ16156: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: BM50316
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: GF12513
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: JA60978
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA60978%27 HTTP/1.1" 200 None
2026-03-30 11:42:35 [auto1.be] INFO: Scrape type for JA60978: 0
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: RD04523
2026-03-30 11:42:35 [auto1.be] INFO: Found listing with ID: SG92006
2026-03-30 11:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG92006%27 HTTP/1.1" 200 None
2026-03-30 11:42:36 [auto1.be] INFO: Scrape type for SG92006: 0
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: PH13121
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH13121%27 HTTP/1.1" 200 None
2026-03-30 11:42:36 [auto1.be] INFO: Scrape type for PH13121: 0
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: EF47293
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF47293%27 HTTP/1.1" 200 None
2026-03-30 11:42:36 [auto1.be] INFO: Scrape type for EF47293: 0
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: GG54325
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: BH83667
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: DA89043
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: AE99564
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE99564%27 HTTP/1.1" 200 None
2026-03-30 11:42:36 [auto1.be] INFO: Scrape type for AE99564: 0
2026-03-30 11:42:36 [auto1.be] INFO: Found listing with ID: BC23498
2026-03-30 11:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF72593> (referer: https://www.auto1.com/v1/car-details-view/FF72593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f022c4e8-09cf-5051-876f-52a87d250a38 with identifier: FF72593
2026-03-30 11:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f022c4e8-09cf-5051-876f-52a87d250a38 with scrape type 1
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f022c4e8-09cf-5051-876f-52a87d250a38
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_10a9fe16cc02f39b2909efd8ba7c013b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_10a9fe16cc02f39b2909efd8ba7c013b.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_894dfddf5a5956a4f6639f13dbae1a0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_894dfddf5a5956a4f6639f13dbae1a0a.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_5f1603efa949dbcbe3f2acce859b490b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_5f1603efa949dbcbe3f2acce859b490b.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_013a5e2d0f84f8752f3920f638153d4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_013a5e2d0f84f8752f3920f638153d4c.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_47b70e703ea9030c8a66aa22a905e155.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_47b70e703ea9030c8a66aa22a905e155.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_8398055e2303a8b1b74bf100e4a9b434.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_8398055e2303a8b1b74bf100e4a9b434.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_686a6e65e02e915bad3bc0e75481734c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_686a6e65e02e915bad3bc0e75481734c.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_a052a19cd9685839176885c86d6e6c67.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_a052a19cd9685839176885c86d6e6c67.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_916295a1861efa1045c43e2fbb8242e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_916295a1861efa1045c43e2fbb8242e0.jpg already downloaded
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fbf%252Fe4bfd67ff2c6d45ecefdf7e68cba2faa%252Fpa%252FFF72593_76b1ed3f0a1c4eb8c2719b3145687b31.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_76b1ed3f0a1c4eb8c2719b3145687b31.jpg already downloaded
2026-03-30 11:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f022c4e8-09cf-5051-876f-52a87d250a38, identifier: FF72593
2026-03-30 11:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f022c4e8-09cf-5051-876f-52a87d250a38 with identifier: FF72593
2026-03-30 11:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f022c4e8-09cf-5051-876f-52a87d250a38 with identifier: FF72593
2026-03-30 11:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f022c4e8-09cf-5051-876f-52a87d250a38 with identifier: FF72593 to the API
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FF72593>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:38:14Z',
 'fuel_type': 'diesel',
 'id': 'f022c4e8-09cf-5051-876f-52a87d250a38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF72593',
 'listing': 'auction',
 'location': 'BE, Pelt',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 193970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_10a9fe16cc02f39b2909efd8ba7c013b.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_894dfddf5a5956a4f6639f13dbae1a0a.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_5f1603efa949dbcbe3f2acce859b490b.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_013a5e2d0f84f8752f3920f638153d4c.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_47b70e703ea9030c8a66aa22a905e155.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_8398055e2303a8b1b74bf100e4a9b434.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_686a6e65e02e915bad3bc0e75481734c.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_a052a19cd9685839176885c86d6e6c67.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_916295a1861efa1045c43e2fbb8242e0.jpg',
                'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_76b1ed3f0a1c4eb8c2719b3145687b31.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_10a9fe16cc02f39b2909efd8ba7c013b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_894dfddf5a5956a4f6639f13dbae1a0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_5f1603efa949dbcbe3f2acce859b490b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_013a5e2d0f84f8752f3920f638153d4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_47b70e703ea9030c8a66aa22a905e155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_8398055e2303a8b1b74bf100e4a9b434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_686a6e65e02e915bad3bc0e75481734c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_a052a19cd9685839176885c86d6e6c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_916295a1861efa1045c43e2fbb8242e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f022c4e8-09cf-5051-876f-52a87d250a38/f022c4e8-09cf-5051-876f-52a87d250a38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/bf/e4bfd67ff2c6d45ecefdf7e68cba2faa/pa/FF72593_76b1ed3f0a1c4eb8c2719b3145687b31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF72593%27 HTTP/1.1" 200 None
2026-03-30 11:42:38 [auto1.be] INFO: Saving data for FF72593: {'created_time': 1774870958.981391, 'last_price_update_time': 1774870958.981402, 'auction_closing_time': 1774971494.0}
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF72593') HTTP/1.1" 204 0
2026-03-30 11:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN67129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF16494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU41998> (referer: https://www.auto1.com/v1/car-details-view/HU41998/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79d2cb1-27dc-576b-b347-cb4dd89c92b6 with identifier: HU41998
2026-03-30 11:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6 with scrape type 1
2026-03-30 11:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_257a8aef2f39edf848aa4959dfd6124e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_257a8aef2f39edf848aa4959dfd6124e.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_9bc6f2692984eb544b856041904fa414.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9bc6f2692984eb544b856041904fa414.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_7bb6af52729b56daeebec99cfec148fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_7bb6af52729b56daeebec99cfec148fd.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_48256e074ff6ce24b62934a027091b9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_48256e074ff6ce24b62934a027091b9f.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_9911451553bf03237cfe2395c5c4a0da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9911451553bf03237cfe2395c5c4a0da.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_b73ce1b6592600e71ea37e1308e41acb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_b73ce1b6592600e71ea37e1308e41acb.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_e37838de8220f8dc56f27170e3090bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_e37838de8220f8dc56f27170e3090bf2.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_94f66caa2c23ea55a4dc741134d2fa62.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_94f66caa2c23ea55a4dc741134d2fa62.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_42eb4c53055c98c7d05106d72fa9ab13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_42eb4c53055c98c7d05106d72fa9ab13.jpg not downloaded yet
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_69531320c6c7979ed2e5062ba0972af3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_69531320c6c7979ed2e5062ba0972af3.jpg not downloaded yet
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9bc6f2692984eb544b856041904fa414.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_257a8aef2f39edf848aa4959dfd6124e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9808050>
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_9bc6f2692984eb544b856041904fa414.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9bc6f2692984eb544b856041904fa414.jpg saved to cache
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea22ded0>
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_257a8aef2f39edf848aa4959dfd6124e.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_257a8aef2f39edf848aa4959dfd6124e.jpg saved to cache
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_69531320c6c7979ed2e5062ba0972af3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a5890>
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_69531320c6c7979ed2e5062ba0972af3.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_69531320c6c7979ed2e5062ba0972af3.jpg saved to cache
2026-03-30 11:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_94f66caa2c23ea55a4dc741134d2fa62.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_48256e074ff6ce24b62934a027091b9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_42eb4c53055c98c7d05106d72fa9ab13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_b73ce1b6592600e71ea37e1308e41acb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9809b90>
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_94f66caa2c23ea55a4dc741134d2fa62.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_94f66caa2c23ea55a4dc741134d2fa62.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9841f90>
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_48256e074ff6ce24b62934a027091b9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_48256e074ff6ce24b62934a027091b9f.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e959c910>
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_42eb4c53055c98c7d05106d72fa9ab13.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_42eb4c53055c98c7d05106d72fa9ab13.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e2690>
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_b73ce1b6592600e71ea37e1308e41acb.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_b73ce1b6592600e71ea37e1308e41acb.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_7bb6af52729b56daeebec99cfec148fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_e37838de8220f8dc56f27170e3090bf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9911451553bf03237cfe2395c5c4a0da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97862d0>
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_7bb6af52729b56daeebec99cfec148fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_7bb6af52729b56daeebec99cfec148fd.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9832950>
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_e37838de8220f8dc56f27170e3090bf2.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_e37838de8220f8dc56f27170e3090bf2.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9787790>
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F74%252Faf7492e28b7647df14350e1e24816499%252Fpa%252FHU41998_9911451553bf03237cfe2395c5c4a0da.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9911451553bf03237cfe2395c5c4a0da.jpg saved to cache
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6
2026-03-30 11:42:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c79d2cb1-27dc-576b-b347-cb4dd89c92b6, skipping ID generation
2026-03-30 11:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6 with scrape type 1
2026-03-30 11:42:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c79d2cb1-27dc-576b-b347-cb4dd89c92b6 sending to next pipeline
2026-03-30 11:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c79d2cb1-27dc-576b-b347-cb4dd89c92b6, identifier: HU41998
2026-03-30 11:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c79d2cb1-27dc-576b-b347-cb4dd89c92b6 with identifier: HU41998
2026-03-30 11:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c79d2cb1-27dc-576b-b347-cb4dd89c92b6 with identifier: HU41998
2026-03-30 11:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c79d2cb1-27dc-576b-b347-cb4dd89c92b6 with identifier: HU41998 to the API
2026-03-30 11:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9911451553bf03237cfe2395c5c4a0da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:47:05Z',
 'fuel_type': 'petrol',
 'id': 'c79d2cb1-27dc-576b-b347-cb4dd89c92b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU41998',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 121091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421007,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_257a8aef2f39edf848aa4959dfd6124e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9bc6f2692984eb544b856041904fa414.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2618573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_7bb6af52729b56daeebec99cfec148fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_48256e074ff6ce24b62934a027091b9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_9911451553bf03237cfe2395c5c4a0da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544082,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_b73ce1b6592600e71ea37e1308e41acb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_e37838de8220f8dc56f27170e3090bf2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_94f66caa2c23ea55a4dc741134d2fa62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_42eb4c53055c98c7d05106d72fa9ab13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c79d2cb1-27dc-576b-b347-cb4dd89c92b6/c79d2cb1-27dc-576b-b347-cb4dd89c92b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/74/af7492e28b7647df14350e1e24816499/pa/HU41998_69531320c6c7979ed2e5062ba0972af3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 11:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU41998%27 HTTP/1.1" 200 None
2026-03-30 11:42:49 [auto1.be] INFO: Saving data for HU41998: {'created_time': 1774870969.475011, 'last_price_update_time': 1774870969.475021, 'auction_closing_time': 1774972025.0}
2026-03-30 11:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU41998') HTTP/1.1" 204 0
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV12777> (referer: https://www.auto1.com/v1/car-details-view/HV12777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:42:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 833bcd12-51d5-5fdc-bd60-90e82889d178 with identifier: HV12777
2026-03-30 11:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 833bcd12-51d5-5fdc-bd60-90e82889d178 with scrape type 1
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_cc0689ddb5cf3d11eb4fd541eb9dad5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_cc0689ddb5cf3d11eb4fd541eb9dad5a.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_278afc2250d5f741f89a3724b26b33d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_278afc2250d5f741f89a3724b26b33d8.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_2ff2e26c9acf1dc87ed42fea21f0931c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_2ff2e26c9acf1dc87ed42fea21f0931c.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_995c9f2e7806d39505b988e8204bab39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_995c9f2e7806d39505b988e8204bab39.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_e6d23a75134bf518423de4ead7887755.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_e6d23a75134bf518423de4ead7887755.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_426df354ba1a2499cc9993ab78dd5dc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_426df354ba1a2499cc9993ab78dd5dc4.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_8688e6ff0033ff26377c4364f9cb780a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_8688e6ff0033ff26377c4364f9cb780a.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_4988bb37a3bf4d39f0f33cc0a0930c72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_4988bb37a3bf4d39f0f33cc0a0930c72.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_11370fb13297b69c32dfe55df8642771.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_11370fb13297b69c32dfe55df8642771.jpg not downloaded yet
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_385269d0f9ee73574cbc7f262e097991.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_385269d0f9ee73574cbc7f262e097991.jpg not downloaded yet
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_cc0689ddb5cf3d11eb4fd541eb9dad5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_278afc2250d5f741f89a3724b26b33d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_e6d23a75134bf518423de4ead7887755.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_4988bb37a3bf4d39f0f33cc0a0930c72.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_11370fb13297b69c32dfe55df8642771.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebfef590>
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_cc0689ddb5cf3d11eb4fd541eb9dad5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_cc0689ddb5cf3d11eb4fd541eb9dad5a.jpg saved to cache
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea208590>
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_278afc2250d5f741f89a3724b26b33d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_278afc2250d5f741f89a3724b26b33d8.jpg saved to cache
2026-03-30 11:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_2ff2e26c9acf1dc87ed42fea21f0931c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_426df354ba1a2499cc9993ab78dd5dc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e986b850>
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_e6d23a75134bf518423de4ead7887755.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_e6d23a75134bf518423de4ead7887755.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98211d0>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_4988bb37a3bf4d39f0f33cc0a0930c72.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_4988bb37a3bf4d39f0f33cc0a0930c72.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9787bd0>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_11370fb13297b69c32dfe55df8642771.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_11370fb13297b69c32dfe55df8642771.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_8688e6ff0033ff26377c4364f9cb780a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e7850>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_2ff2e26c9acf1dc87ed42fea21f0931c.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_2ff2e26c9acf1dc87ed42fea21f0931c.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0ba190>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_426df354ba1a2499cc9993ab78dd5dc4.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_426df354ba1a2499cc9993ab78dd5dc4.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec04e7d0>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_8688e6ff0033ff26377c4364f9cb780a.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_8688e6ff0033ff26377c4364f9cb780a.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_995c9f2e7806d39505b988e8204bab39.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_385269d0f9ee73574cbc7f262e097991.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a03d0>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_995c9f2e7806d39505b988e8204bab39.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_995c9f2e7806d39505b988e8204bab39.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2587d0>
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F6c%252F586cf3a379fd2c3b2cee72ac1f2833a3%252Fpa%252FHV12777_385269d0f9ee73574cbc7f262e097991.jpg') HTTP/1.1" 204 0
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_385269d0f9ee73574cbc7f262e097991.jpg saved to cache
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 833bcd12-51d5-5fdc-bd60-90e82889d178
2026-03-30 11:42:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 833bcd12-51d5-5fdc-bd60-90e82889d178, skipping ID generation
2026-03-30 11:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 833bcd12-51d5-5fdc-bd60-90e82889d178 with scrape type 1
2026-03-30 11:42:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 833bcd12-51d5-5fdc-bd60-90e82889d178 sending to next pipeline
2026-03-30 11:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 833bcd12-51d5-5fdc-bd60-90e82889d178, identifier: HV12777
2026-03-30 11:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 833bcd12-51d5-5fdc-bd60-90e82889d178 with identifier: HV12777
2026-03-30 11:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 833bcd12-51d5-5fdc-bd60-90e82889d178 with identifier: HV12777
2026-03-30 11:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 833bcd12-51d5-5fdc-bd60-90e82889d178 with identifier: HV12777 to the API
2026-03-30 11:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_385269d0f9ee73574cbc7f262e097991.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:29Z',
 'fuel_type': 'petrol',
 'id': '833bcd12-51d5-5fdc-bd60-90e82889d178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV12777',
 'listing': 'auction',
 'location': 'BE, SAINT-MARC',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 118029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_cc0689ddb5cf3d11eb4fd541eb9dad5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_278afc2250d5f741f89a3724b26b33d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371320,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_2ff2e26c9acf1dc87ed42fea21f0931c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_995c9f2e7806d39505b988e8204bab39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335181,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_e6d23a75134bf518423de4ead7887755.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_426df354ba1a2499cc9993ab78dd5dc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738994,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_8688e6ff0033ff26377c4364f9cb780a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_4988bb37a3bf4d39f0f33cc0a0930c72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_11370fb13297b69c32dfe55df8642771.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_833bcd12-51d5-5fdc-bd60-90e82889d178/833bcd12-51d5-5fdc-bd60-90e82889d178_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/6c/586cf3a379fd2c3b2cee72ac1f2833a3/pa/HV12777_385269d0f9ee73574cbc7f262e097991.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Shine M',
 'transmission': 'manual',
 'trim': 'Shine M',
 'year': 2019}
2026-03-30 11:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV12777%27 HTTP/1.1" 200 None
2026-03-30 11:43:00 [auto1.be] INFO: Saving data for HV12777: {'created_time': 1774870980.489559, 'last_price_update_time': 1774870980.489569, 'auction_closing_time': 1774971269.0}
2026-03-30 11:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HV12777') HTTP/1.1" 204 0
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV96018> (referer: https://www.auto1.com/v1/car-details-view/EV96018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 with identifier: EV96018
2026-03-30 11:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 with scrape type 1
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_3a317a86d5e9a5fb5102dc4942c6262b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3a317a86d5e9a5fb5102dc4942c6262b.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_a76c3b72f620818513dcea42c69c7084.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_a76c3b72f620818513dcea42c69c7084.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_3566278740348173f1725a1d06b773f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3566278740348173f1725a1d06b773f2.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_0ec909fe6e9ddede5f36ee9999a7bcc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_0ec909fe6e9ddede5f36ee9999a7bcc5.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_6f4900bf543314ab664401a8b799df37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_6f4900bf543314ab664401a8b799df37.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_8fe93257ee35469f9c1d08a27932e373.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_8fe93257ee35469f9c1d08a27932e373.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_41f23c9131edf9b01fae2471051608e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_41f23c9131edf9b01fae2471051608e7.jpg not downloaded yet
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_bf0e909d08ac2f29a24ed62026fc05de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_bf0e909d08ac2f29a24ed62026fc05de.jpg not downloaded yet
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_a76c3b72f620818513dcea42c69c7084.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3a317a86d5e9a5fb5102dc4942c6262b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_35f953a5a28fdba9fa95d9dce45c913f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_35f953a5a28fdba9fa95d9dce45c913f.jpg not downloaded yet
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3566278740348173f1725a1d06b773f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_0ec909fe6e9ddede5f36ee9999a7bcc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_8fe93257ee35469f9c1d08a27932e373.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL36381> (referer: https://www.auto1.com/v1/car-details-view/LL36381/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_6f4900bf543314ab664401a8b799df37.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_2c4a74a94a9b98df5dce0478c4eee237.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_2c4a74a94a9b98df5dce0478c4eee237.jpg not downloaded yet
2026-03-30 11:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_bf0e909d08ac2f29a24ed62026fc05de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_2c4a74a94a9b98df5dce0478c4eee237.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_35f953a5a28fdba9fa95d9dce45c913f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_41f23c9131edf9b01fae2471051608e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97a4710>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_a76c3b72f620818513dcea42c69c7084.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_a76c3b72f620818513dcea42c69c7084.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95a1910>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_3a317a86d5e9a5fb5102dc4942c6262b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3a317a86d5e9a5fb5102dc4942c6262b.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9733710>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_3566278740348173f1725a1d06b773f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3566278740348173f1725a1d06b773f2.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0d8710>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_0ec909fe6e9ddede5f36ee9999a7bcc5.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_0ec909fe6e9ddede5f36ee9999a7bcc5.jpg saved to cache
2026-03-30 11:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9631010>
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_8fe93257ee35469f9c1d08a27932e373.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_8fe93257ee35469f9c1d08a27932e373.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0bd5e52-90f0-540e-92f8-2797194b9b08 with identifier: LL36381
2026-03-30 11:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0bd5e52-90f0-540e-92f8-2797194b9b08 with scrape type 1
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_82c509935851b6a6f67a2087676a195f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_82c509935851b6a6f67a2087676a195f.jpg not downloaded yet
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9637450>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_6f4900bf543314ab664401a8b799df37.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_6f4900bf543314ab664401a8b799df37.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95ebc50>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_bf0e909d08ac2f29a24ed62026fc05de.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_bf0e909d08ac2f29a24ed62026fc05de.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9634ad0>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_2c4a74a94a9b98df5dce0478c4eee237.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_2c4a74a94a9b98df5dce0478c4eee237.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9653290>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_35f953a5a28fdba9fa95d9dce45c913f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_35f953a5a28fdba9fa95d9dce45c913f.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e964ef10>
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fa5%252F58a5e9c7d8ba4e08d3e3bafd8e80da53%252Fpa%252FEV96018_41f23c9131edf9b01fae2471051608e7.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_41f23c9131edf9b01fae2471051608e7.jpg saved to cache
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56
2026-03-30 11:43:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6f669f8-c442-5e4f-bcf3-54b1c7a59a56, skipping ID generation
2026-03-30 11:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 with scrape type 1
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 sending to next pipeline
2026-03-30 11:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e6f669f8-c442-5e4f-bcf3-54b1c7a59a56, identifier: EV96018
2026-03-30 11:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 with identifier: EV96018
2026-03-30 11:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 with identifier: EV96018
2026-03-30 11:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e6f669f8-c442-5e4f-bcf3-54b1c7a59a56 with identifier: EV96018 to the API
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_41f23c9131edf9b01fae2471051608e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-31T15:01:03Z',
 'fuel_type': 'petrol',
 'id': 'e6f669f8-c442-5e4f-bcf3-54b1c7a59a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV96018',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 69905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3a317a86d5e9a5fb5102dc4942c6262b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_a76c3b72f620818513dcea42c69c7084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_3566278740348173f1725a1d06b773f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_0ec909fe6e9ddede5f36ee9999a7bcc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_6f4900bf543314ab664401a8b799df37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_8fe93257ee35469f9c1d08a27932e373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_41f23c9131edf9b01fae2471051608e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_bf0e909d08ac2f29a24ed62026fc05de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_35f953a5a28fdba9fa95d9dce45c913f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f669f8-c442-5e4f-bcf3-54b1c7a59a56/e6f669f8-c442-5e4f-bcf3-54b1c7a59a56_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/a5/58a5e9c7d8ba4e08d3e3bafd8e80da53/pa/EV96018_2c4a74a94a9b98df5dce0478c4eee237.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV96018%27 HTTP/1.1" 200 None
2026-03-30 11:43:04 [auto1.be] INFO: Saving data for EV96018: {'created_time': 1774870984.931611, 'last_price_update_time': 1774870984.931621, 'auction_closing_time': 1774969263.0}
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV96018') HTTP/1.1" 204 0
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_0a06936aa9bac234ef33d9468bbf0d52.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_0a06936aa9bac234ef33d9468bbf0d52.jpg not downloaded yet
2026-03-30 11:43:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.067(s), this was the 1st time calling it.
2026-03-30 11:43:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.3065491486552645 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.066(s), this was the 1st time calling it.
2026-03-30 11:43:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.038586742727541 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_937fcdace82a1fbcb3746900d1841227.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_937fcdace82a1fbcb3746900d1841227.jpg not downloaded yet
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_dc202cc5e20ba2aa3d6bbc8b48b9cd6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dc202cc5e20ba2aa3d6bbc8b48b9cd6f.jpg not downloaded yet
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_dff0aaaa9c334f8a1ba2ba964b3d4be2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dff0aaaa9c334f8a1ba2ba964b3d4be2.jpg not downloaded yet
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_e3b4eaedf405b8b103d7d774b35a373a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_e3b4eaedf405b8b103d7d774b35a373a.jpg not downloaded yet
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_0a06936aa9bac234ef33d9468bbf0d52.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_82c509935851b6a6f67a2087676a195f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_fd111b4bc6b6115798d92d60f12aaa2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_fd111b4bc6b6115798d92d60f12aaa2c.jpg not downloaded yet
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_6abb2173835f6e6ad3ada854fd050488.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_6abb2173835f6e6ad3ada854fd050488.jpg not downloaded yet
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_d373c947886b541834785a762be9d1f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_d373c947886b541834785a762be9d1f2.jpg not downloaded yet
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dc202cc5e20ba2aa3d6bbc8b48b9cd6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg not downloaded yet
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_e3b4eaedf405b8b103d7d774b35a373a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_fd111b4bc6b6115798d92d60f12aaa2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9659850>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_0a06936aa9bac234ef33d9468bbf0d52.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_0a06936aa9bac234ef33d9468bbf0d52.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ed07e790>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_82c509935851b6a6f67a2087676a195f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_82c509935851b6a6f67a2087676a195f.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97fdd50>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_dc202cc5e20ba2aa3d6bbc8b48b9cd6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dc202cc5e20ba2aa3d6bbc8b48b9cd6f.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e969ec90>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_e3b4eaedf405b8b103d7d774b35a373a.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_e3b4eaedf405b8b103d7d774b35a373a.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea09cb90>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_fd111b4bc6b6115798d92d60f12aaa2c.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_fd111b4bc6b6115798d92d60f12aaa2c.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_d373c947886b541834785a762be9d1f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dff0aaaa9c334f8a1ba2ba964b3d4be2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_937fcdace82a1fbcb3746900d1841227.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec4dad10>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_d373c947886b541834785a762be9d1f2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_d373c947886b541834785a762be9d1f2.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_6abb2173835f6e6ad3ada854fd050488.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9637d10>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_dff0aaaa9c334f8a1ba2ba964b3d4be2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dff0aaaa9c334f8a1ba2ba964b3d4be2.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e5550>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_937fcdace82a1fbcb3746900d1841227.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_937fcdace82a1fbcb3746900d1841227.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF16494> (referer: https://www.auto1.com/v1/car-details-view/GF16494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9762bd0>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_6abb2173835f6e6ad3ada854fd050488.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_6abb2173835f6e6ad3ada854fd050488.jpg saved to cache
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da66344f-5d03-5ef3-a74b-935bdae217af with identifier: GF16494
2026-03-30 11:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da66344f-5d03-5ef3-a74b-935bdae217af with scrape type 1
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item da66344f-5d03-5ef3-a74b-935bdae217af
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_ad5ed50a8eee924824c0e1aa1e99cbb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_ad5ed50a8eee924824c0e1aa1e99cbb9.jpg not downloaded yet
2026-03-30 11:43:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9718cd0>
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F78%252Ff578ecdf8f66bfae192084d41be4b61c%252Fpa%252FLL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e0bd5e52-90f0-540e-92f8-2797194b9b08
2026-03-30 11:43:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e0bd5e52-90f0-540e-92f8-2797194b9b08, skipping ID generation
2026-03-30 11:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0bd5e52-90f0-540e-92f8-2797194b9b08 with scrape type 1
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e0bd5e52-90f0-540e-92f8-2797194b9b08 sending to next pipeline
2026-03-30 11:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0bd5e52-90f0-540e-92f8-2797194b9b08, identifier: LL36381
2026-03-30 11:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0bd5e52-90f0-540e-92f8-2797194b9b08 with identifier: LL36381
2026-03-30 11:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0bd5e52-90f0-540e-92f8-2797194b9b08 with identifier: LL36381
2026-03-30 11:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0bd5e52-90f0-540e-92f8-2797194b9b08 with identifier: LL36381 to the API
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:35:05Z',
 'fuel_type': 'petrol',
 'id': 'e0bd5e52-90f0-540e-92f8-2797194b9b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL36381',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 81032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_82c509935851b6a6f67a2087676a195f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_0a06936aa9bac234ef33d9468bbf0d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_937fcdace82a1fbcb3746900d1841227.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dc202cc5e20ba2aa3d6bbc8b48b9cd6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_dff0aaaa9c334f8a1ba2ba964b3d4be2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_e3b4eaedf405b8b103d7d774b35a373a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_fd111b4bc6b6115798d92d60f12aaa2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394372,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_6abb2173835f6e6ad3ada854fd050488.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_d373c947886b541834785a762be9d1f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0bd5e52-90f0-540e-92f8-2797194b9b08/e0bd5e52-90f0-540e-92f8-2797194b9b08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/78/f578ecdf8f66bfae192084d41be4b61c/pa/LL36381_8ba2b18d896ee82c3d8309b8c4a471e9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL36381%27 HTTP/1.1" 200 None
2026-03-30 11:43:06 [auto1.be] INFO: Saving data for LL36381: {'created_time': 1774870986.59077, 'last_price_update_time': 1774870986.590783, 'auction_closing_time': 1774971305.0}
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LL36381') HTTP/1.1" 204 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_85f970ef27fe61831bc30d2a7dc223f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_85f970ef27fe61831bc30d2a7dc223f8.jpg not downloaded yet
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_4efe9ab09218dcacd0f24b251ecc6f7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_4efe9ab09218dcacd0f24b251ecc6f7a.jpg not downloaded yet
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_b34bd23ea32031f4965497f761eddc9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_b34bd23ea32031f4965497f761eddc9f.jpg not downloaded yet
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg not downloaded yet
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_ad5ed50a8eee924824c0e1aa1e99cbb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_85f970ef27fe61831bc30d2a7dc223f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_4efe9ab09218dcacd0f24b251ecc6f7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_b34bd23ea32031f4965497f761eddc9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea0ef090>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_ad5ed50a8eee924824c0e1aa1e99cbb9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_ad5ed50a8eee924824c0e1aa1e99cbb9.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da66344f-5d03-5ef3-a74b-935bdae217af
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea09ef10>
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_85f970ef27fe61831bc30d2a7dc223f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_85f970ef27fe61831bc30d2a7dc223f8.jpg saved to cache
2026-03-30 11:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da66344f-5d03-5ef3-a74b-935bdae217af
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea27add0>
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_4efe9ab09218dcacd0f24b251ecc6f7a.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_4efe9ab09218dcacd0f24b251ecc6f7a.jpg saved to cache
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da66344f-5d03-5ef3-a74b-935bdae217af
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e9e50>
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_b34bd23ea32031f4965497f761eddc9f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_b34bd23ea32031f4965497f761eddc9f.jpg saved to cache
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da66344f-5d03-5ef3-a74b-935bdae217af
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9863790>
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fd3%252Fd7d3abc4cd73191a2e834066177232a2%252Fpa%252FGF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg saved to cache
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da66344f-5d03-5ef3-a74b-935bdae217af
2026-03-30 11:43:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da66344f-5d03-5ef3-a74b-935bdae217af, skipping ID generation
2026-03-30 11:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da66344f-5d03-5ef3-a74b-935bdae217af with scrape type 1
2026-03-30 11:43:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da66344f-5d03-5ef3-a74b-935bdae217af sending to next pipeline
2026-03-30 11:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da66344f-5d03-5ef3-a74b-935bdae217af, identifier: GF16494
2026-03-30 11:43:07 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 12 pages/min), scraped 117 items (at 8 items/min)
2026-03-30 11:43:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 11:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da66344f-5d03-5ef3-a74b-935bdae217af with identifier: GF16494
2026-03-30 11:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da66344f-5d03-5ef3-a74b-935bdae217af with identifier: GF16494
2026-03-30 11:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da66344f-5d03-5ef3-a74b-935bdae217af with identifier: GF16494 to the API
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.2L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:04:19Z',
 'fuel_type': 'diesel',
 'id': 'da66344f-5d03-5ef3-a74b-935bdae217af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF16494',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 145693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_ad5ed50a8eee924824c0e1aa1e99cbb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_85f970ef27fe61831bc30d2a7dc223f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_4efe9ab09218dcacd0f24b251ecc6f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_b34bd23ea32031f4965497f761eddc9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da66344f-5d03-5ef3-a74b-935bdae217af/da66344f-5d03-5ef3-a74b-935bdae217af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/d3/d7d3abc4cd73191a2e834066177232a2/pa/GF16494_dd38c3fe62b28972bb3bdab057cf8fdc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 280 K LKW',
 'transmission': 'manual',
 'trim': 'FT 280 K LKW',
 'year': 2012}
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF16494%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Saving data for GF16494: {'created_time': 1774870987.680767, 'last_price_update_time': 1774870987.680781, 'auction_closing_time': 1774969459.0}
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF16494') HTTP/1.1" 204 0
2026-03-30 11:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN67129> (referer: https://www.auto1.com/v1/car-details-view/SN67129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:07 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1758 | hits on page: 40
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: VP07407
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for TS12124: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: JY99068
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY99068%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for JY99068: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: JC64183
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: UY40990
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: CM92821
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: TL00014
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL00014%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for TL00014: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: YW02361
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: BC43211
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC43211%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for BC43211: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: JD88445
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD88445%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for JD88445: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: HH39749
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH39749%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for HH39749: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: WY71149
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: DJ79108
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: ER70694
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: UK31480
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: CN63024
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN63024%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for CN63024: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: EB13238
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB13238%27 HTTP/1.1" 200 None
2026-03-30 11:43:07 [auto1.be] INFO: Scrape type for EB13238: 0
2026-03-30 11:43:07 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-30 11:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for YU54459: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: NS58610
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: VK40214
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK40214%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for VK40214: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: KM41856
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM41856%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for KM41856: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: FG04950
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG04950%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for FG04950: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: SR54305
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN29778%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for YN29778: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX00210%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for KX00210: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-30 11:43:08 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 11:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a18169d-b23c-5d08-a493-71e8ae9aa56c with identifier: SN67129
2026-03-30 11:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c with scrape type 1
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_574b6f6147de35fb14aced0f80ca6830.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_574b6f6147de35fb14aced0f80ca6830.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_6f5f8ab38afcdc45d9ffdf50c46d3c4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_6f5f8ab38afcdc45d9ffdf50c46d3c4b.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_f3a3a1f131e892595d27a4525d0b8cf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_f3a3a1f131e892595d27a4525d0b8cf9.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_7949a69a2560b1a26812e188cad03473.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_7949a69a2560b1a26812e188cad03473.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_faaf73f2330474891ac36473b0181be5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_faaf73f2330474891ac36473b0181be5.jpg not downloaded yet
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_574b6f6147de35fb14aced0f80ca6830.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_9d1cd875d5462bc12b9b0ce8643c89aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_9d1cd875d5462bc12b9b0ce8643c89aa.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_fecfee8f39659fbc802d79778e412474.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_fecfee8f39659fbc802d79778e412474.jpg not downloaded yet
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_0f5bdd285213d6f07d6095988028dd64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_0f5bdd285213d6f07d6095988028dd64.jpg not downloaded yet
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_6f5f8ab38afcdc45d9ffdf50c46d3c4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_f3a3a1f131e892595d27a4525d0b8cf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_ef0b4c7c07fa2571ab7311ce9d40cea9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_ef0b4c7c07fa2571ab7311ce9d40cea9.jpg not downloaded yet
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_faaf73f2330474891ac36473b0181be5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_7949a69a2560b1a26812e188cad03473.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_9d1cd875d5462bc12b9b0ce8643c89aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_0f5bdd285213d6f07d6095988028dd64.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e969cdd0>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_574b6f6147de35fb14aced0f80ca6830.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_574b6f6147de35fb14aced0f80ca6830.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_ef0b4c7c07fa2571ab7311ce9d40cea9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95d57d0>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_6f5f8ab38afcdc45d9ffdf50c46d3c4b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_6f5f8ab38afcdc45d9ffdf50c46d3c4b.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2e4e90>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_f3a3a1f131e892595d27a4525d0b8cf9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_f3a3a1f131e892595d27a4525d0b8cf9.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9827710>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_faaf73f2330474891ac36473b0181be5.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_faaf73f2330474891ac36473b0181be5.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96ad690>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_7949a69a2560b1a26812e188cad03473.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_7949a69a2560b1a26812e188cad03473.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea27ee50>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_9d1cd875d5462bc12b9b0ce8643c89aa.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_9d1cd875d5462bc12b9b0ce8643c89aa.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96f5050>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_0f5bdd285213d6f07d6095988028dd64.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_0f5bdd285213d6f07d6095988028dd64.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e986a110>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_ef0b4c7c07fa2571ab7311ce9d40cea9.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_ef0b4c7c07fa2571ab7311ce9d40cea9.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_fecfee8f39659fbc802d79778e412474.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea10ce90>
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_fecfee8f39659fbc802d79778e412474.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_fecfee8f39659fbc802d79778e412474.jpg saved to cache
2026-03-30 11:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:43:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:43:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:43:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:43:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96db310>
2026-03-30 11:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fd7%252F33d7725b920b7ee2da7f7877f4d8cb92%252Fpa%252FSN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg saved to cache
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c
2026-03-30 11:43:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a18169d-b23c-5d08-a493-71e8ae9aa56c, skipping ID generation
2026-03-30 11:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c with scrape type 1
2026-03-30 11:43:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a18169d-b23c-5d08-a493-71e8ae9aa56c sending to next pipeline
2026-03-30 11:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a18169d-b23c-5d08-a493-71e8ae9aa56c, identifier: SN67129
2026-03-30 11:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a18169d-b23c-5d08-a493-71e8ae9aa56c with identifier: SN67129
2026-03-30 11:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a18169d-b23c-5d08-a493-71e8ae9aa56c with identifier: SN67129
2026-03-30 11:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a18169d-b23c-5d08-a493-71e8ae9aa56c with identifier: SN67129 to the API
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 67,
 'expiration_date': '2026-03-31T15:58:08Z',
 'fuel_type': 'petrol',
 'id': '4a18169d-b23c-5d08-a493-71e8ae9aa56c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN67129',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 181212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3843045,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_970d6ff1eaa0df4f9d1eca8625c313f5.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_574b6f6147de35fb14aced0f80ca6830.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_6f5f8ab38afcdc45d9ffdf50c46d3c4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_f3a3a1f131e892595d27a4525d0b8cf9.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_7949a69a2560b1a26812e188cad03473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_faaf73f2330474891ac36473b0181be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_9d1cd875d5462bc12b9b0ce8643c89aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_fecfee8f39659fbc802d79778e412474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_0f5bdd285213d6f07d6095988028dd64.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a18169d-b23c-5d08-a493-71e8ae9aa56c/4a18169d-b23c-5d08-a493-71e8ae9aa56c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/d7/33d7725b920b7ee2da7f7877f4d8cb92/pa/SN67129_ef0b4c7c07fa2571ab7311ce9d40cea9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN67129%27 HTTP/1.1" 200 None
2026-03-30 11:43:09 [auto1.be] INFO: Saving data for SN67129: {'created_time': 1774870989.847231, 'last_price_update_time': 1774870989.847246, 'auction_closing_time': 1774972688.0}
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN67129') HTTP/1.1" 204 0
2026-03-30 11:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:10 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1758 | hits on page: 40
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR76359%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for VR76359: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC01857%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for ZC01857: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV43445%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for JV43445: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP46156%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for YP46156: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD38906%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for KD38906: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG03200%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for DG03200: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW53084%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for VW53084: 0
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for RJ95996: 2
2026-03-30 11:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c560f353-0ba4-5da9-8361-0443dd9ebc9f with identifier: RJ95996
2026-03-30 11:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c560f353-0ba4-5da9-8361-0443dd9ebc9f with scrape type 2
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c560f353-0ba4-5da9-8361-0443dd9ebc9f with scrape type 2
2026-03-30 11:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c560f353-0ba4-5da9-8361-0443dd9ebc9f, identifier: RJ95996
2026-03-30 11:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c560f353-0ba4-5da9-8361-0443dd9ebc9f with identifier: RJ95996
2026-03-30 11:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c560f353-0ba4-5da9-8361-0443dd9ebc9f with identifier: RJ95996
2026-03-30 11:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c560f353-0ba4-5da9-8361-0443dd9ebc9f with identifier: RJ95996 to the API
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:46:30Z',
 'fuel_type': 'diesel',
 'id': 'c560f353-0ba4-5da9-8361-0443dd9ebc9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ95996',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 78469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-12',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Ocean Race',
 'transmission': 'manual',
 'trim': 'Ocean Race',
 'year': 2016}
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Saving data for RJ95996: {'auction_closing_time': 1774885590.0, 'created_time': 1773995525.86454, 'last_price_update_time': 1774870990.67597}
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ95996') HTTP/1.1" 204 0
2026-03-30 11:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:10 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-30 11:43:10 [auto1.be] INFO: Scrape type for LU32507: 2
2026-03-30 11:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cda55fc3-5ad8-55c0-bb2b-456d05e4002a with identifier: LU32507
2026-03-30 11:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cda55fc3-5ad8-55c0-bb2b-456d05e4002a with scrape type 2
2026-03-30 11:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cda55fc3-5ad8-55c0-bb2b-456d05e4002a with scrape type 2
2026-03-30 11:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cda55fc3-5ad8-55c0-bb2b-456d05e4002a, identifier: LU32507
2026-03-30 11:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cda55fc3-5ad8-55c0-bb2b-456d05e4002a with identifier: LU32507
2026-03-30 11:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cda55fc3-5ad8-55c0-bb2b-456d05e4002a with identifier: LU32507
2026-03-30 11:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cda55fc3-5ad8-55c0-bb2b-456d05e4002a with identifier: LU32507 to the API
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:20:42Z',
 'fuel_type': 'diesel',
 'id': 'cda55fc3-5ad8-55c0-bb2b-456d05e4002a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU32507',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 125281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2014}
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.be] INFO: Saving data for LU32507: {'auction_closing_time': 1774884042.0, 'created_time': 1774298019.099021, 'last_price_update_time': 1774870991.247753}
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LU32507') HTTP/1.1" 204 0
2026-03-30 11:43:11 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.be] INFO: Scrape type for FT44143: 2
2026-03-30 11:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88e0615c-4b2e-518e-865c-7e645d151f81 with identifier: FT44143
2026-03-30 11:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88e0615c-4b2e-518e-865c-7e645d151f81 with scrape type 2
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88e0615c-4b2e-518e-865c-7e645d151f81 with scrape type 2
2026-03-30 11:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 88e0615c-4b2e-518e-865c-7e645d151f81, identifier: FT44143
2026-03-30 11:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 88e0615c-4b2e-518e-865c-7e645d151f81 with identifier: FT44143
2026-03-30 11:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 88e0615c-4b2e-518e-865c-7e645d151f81 with identifier: FT44143
2026-03-30 11:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 88e0615c-4b2e-518e-865c-7e645d151f81 with identifier: FT44143 to the API
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:24Z',
 'fuel_type': 'diesel',
 'id': '88e0615c-4b2e-518e-865c-7e645d151f81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT44143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 107262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-23',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten Economy',
 'transmission': 'manual',
 'trim': 'Kasten Economy',
 'year': 2014}
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.be] INFO: Saving data for FT44143: {'auction_closing_time': 1774883844.0, 'created_time': 1774265517.441191, 'last_price_update_time': 1774870991.641135}
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT44143') HTTP/1.1" 204 0
2026-03-30 11:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:11 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-30 11:43:11 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-30 11:43:11 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-30 11:43:11 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-30 11:43:11 [auto1.be] INFO: Scrape type for VR58028: 2
2026-03-30 11:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028
2026-03-30 11:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with scrape type 2
2026-03-30 11:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with scrape type 2
2026-03-30 11:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf912a50-820d-5ba2-91dc-af58d9f2e9f1, identifier: VR58028
2026-03-30 11:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028
2026-03-30 11:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028
2026-03-30 11:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028 to the API
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:33:52Z',
 'fuel_type': 'petrol',
 'id': 'bf912a50-820d-5ba2-91dc-af58d9f2e9f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR58028',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 75297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [auto1.be] INFO: Saving data for VR58028: {'auction_closing_time': 1774884832.0, 'created_time': 1774773298.339036, 'last_price_update_time': 1774870992.05915}
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VR58028') HTTP/1.1" 204 0
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [auto1.be] INFO: Scrape type for ES45973: 0
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-30 11:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:12 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1758 | hits on page: 40
2026-03-30 11:43:12 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-30 11:43:12 [auto1.be] INFO: Scrape type for MB50362: 2
2026-03-30 11:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362
2026-03-30 11:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with scrape type 2
2026-03-30 11:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with scrape type 2
2026-03-30 11:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4, identifier: MB50362
2026-03-30 11:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362
2026-03-30 11:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362
2026-03-30 11:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362 to the API
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:10:13Z',
 'fuel_type': 'diesel',
 'id': '2ee7d5c7-cff2-5eb2-9713-c32980a867c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB50362',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 130099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Saving data for MB50362: {'auction_closing_time': 1774883413.0, 'created_time': 1774773247.278138, 'last_price_update_time': 1774870993.233153}
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB50362') HTTP/1.1" 204 0
2026-03-30 11:43:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Scrape type for AD75254: 0
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Scrape type for JZ74663: 0
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Scrape type for JW28444: 0
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Scrape type for ST41989: 2
2026-03-30 11:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989
2026-03-30 11:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 443175be-9a03-5576-987a-6e7e3228f843 with scrape type 2
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 443175be-9a03-5576-987a-6e7e3228f843 with scrape type 2
2026-03-30 11:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 443175be-9a03-5576-987a-6e7e3228f843, identifier: ST41989
2026-03-30 11:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989
2026-03-30 11:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989
2026-03-30 11:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989 to the API
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 442,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'hybrid',
 'id': '443175be-9a03-5576-987a-6e7e3228f843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST41989',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 140699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 500e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Saving data for ST41989: {'auction_closing_time': 1774882837.0, 'created_time': 1774773307.880272, 'last_price_update_time': 1774870993.843147}
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST41989') HTTP/1.1" 204 0
2026-03-30 11:43:13 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-30 11:43:13 [auto1.be] INFO: Scrape type for SB58546: 2
2026-03-30 11:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546
2026-03-30 11:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd0bbec-aa45-5144-8f45-295b194dd54b with scrape type 2
2026-03-30 11:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdd0bbec-aa45-5144-8f45-295b194dd54b with scrape type 2
2026-03-30 11:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fdd0bbec-aa45-5144-8f45-295b194dd54b, identifier: SB58546
2026-03-30 11:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546
2026-03-30 11:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546
2026-03-30 11:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546 to the API
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:22Z',
 'fuel_type': 'diesel',
 'id': 'fdd0bbec-aa45-5144-8f45-295b194dd54b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB58546',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 125128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-30 11:43:14 [auto1.be] INFO: Saving data for SB58546: {'auction_closing_time': 1774883062.0, 'created_time': 1774773238.996802, 'last_price_update_time': 1774870994.25962}
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB58546') HTTP/1.1" 204 0
2026-03-30 11:43:14 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-30 11:43:14 [auto1.be] INFO: Scrape type for ZN33988: 2
2026-03-30 11:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988
2026-03-30 11:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with scrape type 2
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with scrape type 2
2026-03-30 11:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 49298cd1-b064-5d4f-b5c5-a80950cfcd56, identifier: ZN33988
2026-03-30 11:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988
2026-03-30 11:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988
2026-03-30 11:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988 to the API
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:19:00Z',
 'fuel_type': 'petrol',
 'id': '49298cd1-b064-5d4f-b5c5-a80950cfcd56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN33988',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 130409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2017}
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-30 11:43:14 [auto1.be] INFO: Saving data for ZN33988: {'auction_closing_time': 1774883940.0, 'created_time': 1774773229.182064, 'last_price_update_time': 1774870994.636677}
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN33988') HTTP/1.1" 204 0
2026-03-30 11:43:14 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-30 11:43:14 [auto1.be] INFO: Scrape type for WV98137: 0
2026-03-30 11:43:14 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-30 11:43:14 [auto1.be] INFO: Scrape type for WM98444: 2
2026-03-30 11:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444
2026-03-30 11:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b777af9e-1d94-5fa1-8911-0d7ce4165688 with scrape type 2
2026-03-30 11:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b777af9e-1d94-5fa1-8911-0d7ce4165688 with scrape type 2
2026-03-30 11:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b777af9e-1d94-5fa1-8911-0d7ce4165688, identifier: WM98444
2026-03-30 11:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444
2026-03-30 11:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444
2026-03-30 11:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444 to the API
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-30T15:21:17Z',
 'fuel_type': 'hybrid',
 'id': 'b777af9e-1d94-5fa1-8911-0d7ce4165688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM98444',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 167413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-05',
 'seller_name': None,
 'title': 'BMW 7er 740e L xDrive',
 'transmission': 'automatic',
 'trim': 'L xDrive',
 'year': 2017}
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Saving data for WM98444: {'auction_closing_time': 1774884077.0, 'created_time': 1774773238.25281, 'last_price_update_time': 1774870995.047045}
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM98444') HTTP/1.1" 204 0
2026-03-30 11:43:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.728(s), this was the 1st time calling it.
2026-03-30 11:43:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.809687314869123 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Scrape type for NE45749: 2
2026-03-30 11:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749
2026-03-30 11:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5fb942-e948-5db9-b12d-a17eac615578 with scrape type 2
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5fb942-e948-5db9-b12d-a17eac615578 with scrape type 2
2026-03-30 11:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af5fb942-e948-5db9-b12d-a17eac615578, identifier: NE45749
2026-03-30 11:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749
2026-03-30 11:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749
2026-03-30 11:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749 to the API
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:46:28Z',
 'fuel_type': 'petrol',
 'id': 'af5fb942-e948-5db9-b12d-a17eac615578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE45749',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 79682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Saving data for NE45749: {'auction_closing_time': 1774885588.0, 'created_time': 1774773307.07252, 'last_price_update_time': 1774870995.558524}
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE45749') HTTP/1.1" 204 0
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Scrape type for XS85102: 0
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Scrape type for GB22067: 0
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-30 11:43:15 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-30 11:43:15 [auto1.be] INFO: Scrape type for BJ49980: 2
2026-03-30 11:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980
2026-03-30 11:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b52c4e-8788-5011-8692-cbd27fb7c047 with scrape type 2
2026-03-30 11:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28b52c4e-8788-5011-8692-cbd27fb7c047 with scrape type 2
2026-03-30 11:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28b52c4e-8788-5011-8692-cbd27fb7c047, identifier: BJ49980
2026-03-30 11:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980
2026-03-30 11:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980
2026-03-30 11:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980 to the API
2026-03-30 11:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:57:22Z',
 'fuel_type': 'diesel',
 'id': '28b52c4e-8788-5011-8692-cbd27fb7c047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ49980',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 230805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2017}
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-30 11:43:16 [auto1.be] INFO: Saving data for BJ49980: {'auction_closing_time': 1774886242.0, 'created_time': 1774773233.998929, 'last_price_update_time': 1774870996.356939}
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ49980') HTTP/1.1" 204 0
2026-03-30 11:43:16 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-30 11:43:16 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-30 11:43:16 [auto1.be] INFO: Scrape type for ZZ18378: 0
2026-03-30 11:43:16 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-30 11:43:16 [auto1.be] INFO: Scrape type for GN69495: 2
2026-03-30 11:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495
2026-03-30 11:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a74937-ba7e-5b83-a458-8f94fe764bdd with scrape type 2
2026-03-30 11:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a74937-ba7e-5b83-a458-8f94fe764bdd with scrape type 2
2026-03-30 11:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a74937-ba7e-5b83-a458-8f94fe764bdd, identifier: GN69495
2026-03-30 11:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN71185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495
2026-03-30 11:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495
2026-03-30 11:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495 to the API
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:04Z',
 'fuel_type': 'diesel',
 'id': '96a74937-ba7e-5b83-a458-8f94fe764bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN69495',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Connect',
 'odometer': 122869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-29',
 'seller_name': None,
 'title': 'Ford Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-30 11:43:16 [auto1.be] INFO: Saving data for GN69495: {'auction_closing_time': 1774886224.0, 'created_time': 1774773241.545887, 'last_price_update_time': 1774870996.981409}
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN69495') HTTP/1.1" 204 0
2026-03-30 11:43:16 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-30 11:43:17 [auto1.be] INFO: Scrape type for XD29708: 2
2026-03-30 11:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708
2026-03-30 11:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with scrape type 2
2026-03-30 11:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with scrape type 2
2026-03-30 11:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65, identifier: XD29708
2026-03-30 11:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708
2026-03-30 11:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708
2026-03-30 11:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708 to the API
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:47:09Z',
 'fuel_type': 'hybrid',
 'id': 'd69e4286-3d5c-56bc-8be5-eacf2bd1ef65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD29708',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 49130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300de AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-30 11:43:17 [auto1.be] INFO: Saving data for XD29708: {'auction_closing_time': 1774885629.0, 'created_time': 1774773317.838464, 'last_price_update_time': 1774870997.390431}
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD29708') HTTP/1.1" 204 0
2026-03-30 11:43:17 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-30 11:43:17 [auto1.be] INFO: Scrape type for SK35491: 2
2026-03-30 11:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491
2026-03-30 11:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b537895-131b-5167-bc4c-b25fab66a524 with scrape type 2
2026-03-30 11:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b537895-131b-5167-bc4c-b25fab66a524 with scrape type 2
2026-03-30 11:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b537895-131b-5167-bc4c-b25fab66a524, identifier: SK35491
2026-03-30 11:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491
2026-03-30 11:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491
2026-03-30 11:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491 to the API
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:24Z',
 'fuel_type': 'diesel',
 'id': '9b537895-131b-5167-bc4c-b25fab66a524',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK35491',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 499766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI Select lang',
 'transmission': 'automatic',
 'trim': 'Select lang',
 'year': 2021}
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-30 11:43:17 [auto1.be] INFO: Saving data for SK35491: {'auction_closing_time': 1774885104.0, 'created_time': 1774773240.821191, 'last_price_update_time': 1774870997.813732}
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK35491') HTTP/1.1" 204 0
2026-03-30 11:43:17 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-30 11:43:17 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-30 11:43:17 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-30 11:43:17 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-30 11:43:17 [auto1.be] INFO: Scrape type for DE26055: 2
2026-03-30 11:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055
2026-03-30 11:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73524b7c-84a3-5c68-b1ec-ec391af4acdb with scrape type 2
2026-03-30 11:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73524b7c-84a3-5c68-b1ec-ec391af4acdb with scrape type 2
2026-03-30 11:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73524b7c-84a3-5c68-b1ec-ec391af4acdb, identifier: DE26055
2026-03-30 11:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055
2026-03-30 11:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055
2026-03-30 11:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055 to the API
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:23:15Z',
 'fuel_type': 'diesel',
 'id': '73524b7c-84a3-5c68-b1ec-ec391af4acdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE26055',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 81926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-30 11:43:18 [auto1.be] INFO: Saving data for DE26055: {'auction_closing_time': 1774884195.0, 'created_time': 1774773316.675539, 'last_price_update_time': 1774870998.210571}
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE26055') HTTP/1.1" 204 0
2026-03-30 11:43:18 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-30 11:43:18 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-30 11:43:18 [auto1.be] INFO: Scrape type for ET26989: 2
2026-03-30 11:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989
2026-03-30 11:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d6c1b19-1140-598b-b706-2d1daf1b729e with scrape type 2
2026-03-30 11:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d6c1b19-1140-598b-b706-2d1daf1b729e with scrape type 2
2026-03-30 11:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d6c1b19-1140-598b-b706-2d1daf1b729e, identifier: ET26989
2026-03-30 11:43:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989
2026-03-30 11:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989
2026-03-30 11:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989 to the API
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:45:57Z',
 'fuel_type': 'diesel',
 'id': '9d6c1b19-1140-598b-b706-2d1daf1b729e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET26989',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 117110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-30 11:43:18 [auto1.be] INFO: Saving data for ET26989: {'auction_closing_time': 1774885557.0, 'created_time': 1774773311.128468, 'last_price_update_time': 1774870998.700403}
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET26989') HTTP/1.1" 204 0
2026-03-30 11:43:18 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-30 11:43:18 [auto1.be] INFO: Scrape type for PF75414: 2
2026-03-30 11:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414
2026-03-30 11:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with scrape type 2
2026-03-30 11:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with scrape type 2
2026-03-30 11:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4, identifier: PF75414
2026-03-30 11:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414
2026-03-30 11:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414
2026-03-30 11:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414 to the API
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:02Z',
 'fuel_type': 'petrol',
 'id': '060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF75414',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 52972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Roadtrip',
 'transmission': 'automatic',
 'trim': 'Roadtrip',
 'year': 2022}
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.be] INFO: Saving data for PF75414: {'auction_closing_time': 1774885502.0, 'created_time': 1774773311.464008, 'last_price_update_time': 1774870999.198611}
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF75414') HTTP/1.1" 204 0
2026-03-30 11:43:19 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.be] INFO: Scrape type for WZ74297: 2
2026-03-30 11:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297
2026-03-30 11:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb03575-7c48-51bf-b4a6-185707101d75 with scrape type 2
2026-03-30 11:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb03575-7c48-51bf-b4a6-185707101d75 with scrape type 2
2026-03-30 11:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcb03575-7c48-51bf-b4a6-185707101d75, identifier: WZ74297
2026-03-30 11:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297
2026-03-30 11:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297
2026-03-30 11:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297 to the API
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:00:02Z',
 'fuel_type': 'petrol',
 'id': 'dcb03575-7c48-51bf-b4a6-185707101d75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ74297',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 102275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 IG-T Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.be] INFO: Saving data for WZ74297: {'auction_closing_time': 1774882802.0, 'created_time': 1774773310.773222, 'last_price_update_time': 1774870999.6441}
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ74297') HTTP/1.1" 204 0
2026-03-30 11:43:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:19 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-30 11:43:19 [auto1.be] INFO: Scrape type for KR32592: 2
2026-03-30 11:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-30 11:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with scrape type 2
2026-03-30 11:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with scrape type 2
2026-03-30 11:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 703f2f46-f56c-59ff-96af-31a1c1f2ea69, identifier: KR32592
2026-03-30 11:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-30 11:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-30 11:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592 to the API
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'diesel',
 'id': '703f2f46-f56c-59ff-96af-31a1c1f2ea69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR32592',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 191574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.be] INFO: Saving data for KR32592: {'auction_closing_time': 1774884333.0, 'created_time': 1773834369.162697, 'last_price_update_time': 1774871000.072361}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR32592') HTTP/1.1" 204 0
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.be] INFO: Scrape type for WU68692: 2
2026-03-30 11:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692
2026-03-30 11:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6815ca9d-4068-5b1e-bccc-ae236f2d2599, identifier: WU68692
2026-03-30 11:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692
2026-03-30 11:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692
2026-03-30 11:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692 to the API
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': '6815ca9d-4068-5b1e-bccc-ae236f2d2599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU68692',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 236106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-10',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.be] INFO: Saving data for WU68692: {'auction_closing_time': 1774885633.0, 'created_time': 1773866553.713628, 'last_price_update_time': 1774871000.544059}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU68692') HTTP/1.1" 204 0
2026-03-30 11:43:20 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1758 | hits on page: 40
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.be] INFO: Scrape type for DX83468: 2
2026-03-30 11:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468
2026-03-30 11:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f8c4335-1e3a-59bc-adee-722b26e208c9 with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f8c4335-1e3a-59bc-adee-722b26e208c9 with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f8c4335-1e3a-59bc-adee-722b26e208c9, identifier: DX83468
2026-03-30 11:43:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468
2026-03-30 11:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468
2026-03-30 11:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468 to the API
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:18Z',
 'fuel_type': 'diesel',
 'id': '1f8c4335-1e3a-59bc-adee-722b26e208c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX83468',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 181964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-07',
 'seller_name': None,
 'title': 'Opel Tigra 1.3 CDTI Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.be] INFO: Saving data for DX83468: {'auction_closing_time': 1774885758.0, 'created_time': 1774557159.699622, 'last_price_update_time': 1774871000.96024}
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DX83468') HTTP/1.1" 204 0
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-30 11:43:20 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-30 11:43:20 [auto1.be] INFO: Scrape type for SD20873: 2
2026-03-30 11:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-30 11:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a377605a-c058-5b4f-99e8-896e420b40df with scrape type 2
2026-03-30 11:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a377605a-c058-5b4f-99e8-896e420b40df with scrape type 2
2026-03-30 11:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a377605a-c058-5b4f-99e8-896e420b40df, identifier: SD20873
2026-03-30 11:43:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.790(s), this was the 2nd time calling it.
2026-03-30 11:43:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 8.222817520886265 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-30 11:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-30 11:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873 to the API
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:22:22Z',
 'fuel_type': 'diesel',
 'id': 'a377605a-c058-5b4f-99e8-896e420b40df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD20873',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 144987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 DTI Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2003}
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-30 11:43:21 [auto1.be] INFO: Saving data for SD20873: {'auction_closing_time': 1774884142.0, 'created_time': 1774470971.15276, 'last_price_update_time': 1774871001.38143}
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD20873') HTTP/1.1" 204 0
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-30 11:43:21 [auto1.be] INFO: Scrape type for EN78807: 2
2026-03-30 11:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807
2026-03-30 11:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1552eff-f68b-5399-a228-70d5fa5e2bbd with scrape type 2
2026-03-30 11:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1552eff-f68b-5399-a228-70d5fa5e2bbd with scrape type 2
2026-03-30 11:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1552eff-f68b-5399-a228-70d5fa5e2bbd, identifier: EN78807
2026-03-30 11:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807
2026-03-30 11:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807
2026-03-30 11:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807 to the API
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:45Z',
 'fuel_type': 'petrol',
 'id': 'd1552eff-f68b-5399-a228-70d5fa5e2bbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN78807',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 99041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-17',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-30 11:43:21 [auto1.be] INFO: Saving data for EN78807: {'auction_closing_time': 1774884285.0, 'created_time': 1774773319.368262, 'last_price_update_time': 1774871001.866043}
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN78807') HTTP/1.1" 204 0
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-30 11:43:21 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-30 11:43:21 [auto1.be] INFO: Scrape type for PC06950: 2
2026-03-30 11:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-30 11:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b6b51-4eac-5af1-9292-9a719642bc7d with scrape type 2
2026-03-30 11:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648b6b51-4eac-5af1-9292-9a719642bc7d with scrape type 2
2026-03-30 11:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 648b6b51-4eac-5af1-9292-9a719642bc7d, identifier: PC06950
2026-03-30 11:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX41608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-30 11:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-30 11:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950 to the API
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:32:41Z',
 'fuel_type': 'petrol',
 'id': '648b6b51-4eac-5af1-9292-9a719642bc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC06950',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 69680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-16',
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2002}
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [auto1.be] INFO: Saving data for PC06950: {'auction_closing_time': 1774884761.0, 'created_time': 1774643596.097313, 'last_price_update_time': 1774871002.556494}
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC06950') HTTP/1.1" 204 0
2026-03-30 11:43:22 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-30 11:43:22 [auto1.be] INFO: Scrape type for JN34238: 2
2026-03-30 11:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-30 11:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16dee46-3c6b-5250-b941-c1842c6f1538 with scrape type 2
2026-03-30 11:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a16dee46-3c6b-5250-b941-c1842c6f1538 with scrape type 2
2026-03-30 11:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a16dee46-3c6b-5250-b941-c1842c6f1538, identifier: JN34238
2026-03-30 11:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-30 11:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-30 11:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238 to the API
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:18Z',
 'fuel_type': 'diesel',
 'id': 'a16dee46-3c6b-5250-b941-c1842c6f1538',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 252589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-09',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-30 11:43:23 [auto1.be] INFO: Saving data for JN34238: {'auction_closing_time': 1774885518.0, 'created_time': 1773237973.441181, 'last_price_update_time': 1774871003.084098}
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JN34238') HTTP/1.1" 204 0
2026-03-30 11:43:23 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-30 11:43:23 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-30 11:43:23 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-30 11:43:23 [auto1.be] INFO: Scrape type for ZC87174: 2
2026-03-30 11:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-30 11:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with scrape type 2
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with scrape type 2
2026-03-30 11:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4, identifier: ZC87174
2026-03-30 11:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 11:43:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-30 11:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174 to the API
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:20:48Z',
 'fuel_type': 'diesel',
 'id': '1da2ecfb-0357-5a49-a64a-3f5fff6d28b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC87174',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 199523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.9 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-30 11:43:23 [auto1.be] INFO: Saving data for ZC87174: {'auction_closing_time': 1774884048.0, 'created_time': 1773301759.801402, 'last_price_update_time': 1774871003.646222}
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC87174') HTTP/1.1" 204 0
2026-03-30 11:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:23 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-30 11:43:23 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-30 11:43:23 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-30 11:43:23 [auto1.be] INFO: Scrape type for GZ17047: 2
2026-03-30 11:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047
2026-03-30 11:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07dc1ade-6431-5648-9305-f3d9cca346f9 with scrape type 2
2026-03-30 11:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07dc1ade-6431-5648-9305-f3d9cca346f9 with scrape type 2
2026-03-30 11:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07dc1ade-6431-5648-9305-f3d9cca346f9, identifier: GZ17047
2026-03-30 11:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047
2026-03-30 11:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047
2026-03-30 11:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047 to the API
2026-03-30 11:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'petrol',
 'id': '07dc1ade-6431-5648-9305-f3d9cca346f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ17047',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 99044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-29',
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Sport 4x2',
 'transmission': 'manual',
 'trim': 'Sport 4x2',
 'year': 2019}
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-30 11:43:24 [auto1.be] INFO: Saving data for GZ17047: {'auction_closing_time': 1774885062.0, 'created_time': 1774773320.904222, 'last_price_update_time': 1774871004.140492}
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GZ17047') HTTP/1.1" 204 0
2026-03-30 11:43:24 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-30 11:43:24 [auto1.be] INFO: Scrape type for TN87621: 2
2026-03-30 11:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621
2026-03-30 11:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58fa2b00-9f22-5a04-aa15-7dfc862916ba with scrape type 2
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58fa2b00-9f22-5a04-aa15-7dfc862916ba with scrape type 2
2026-03-30 11:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58fa2b00-9f22-5a04-aa15-7dfc862916ba, identifier: TN87621
2026-03-30 11:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621
2026-03-30 11:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621
2026-03-30 11:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621 to the API
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:46Z',
 'fuel_type': 'diesel',
 'id': '58fa2b00-9f22-5a04-aa15-7dfc862916ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN87621',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 245165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-30 11:43:24 [auto1.be] INFO: Saving data for TN87621: {'auction_closing_time': 1774885246.0, 'created_time': 1773693392.714576, 'last_price_update_time': 1774871004.596105}
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TN87621') HTTP/1.1" 204 0
2026-03-30 11:43:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:24 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-30 11:43:24 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-30 11:43:24 [auto1.be] INFO: Scrape type for DP17314: 2
2026-03-30 11:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314
2026-03-30 11:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e53342b-0f9c-511d-8783-d9dea083c6e9 with scrape type 2
2026-03-30 11:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e53342b-0f9c-511d-8783-d9dea083c6e9 with scrape type 2
2026-03-30 11:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e53342b-0f9c-511d-8783-d9dea083c6e9, identifier: DP17314
2026-03-30 11:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314
2026-03-30 11:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314
2026-03-30 11:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314 to the API
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:52Z',
 'fuel_type': 'petrol',
 'id': '2e53342b-0f9c-511d-8783-d9dea083c6e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP17314',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 90855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2021}
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-30 11:43:25 [auto1.be] INFO: Saving data for DP17314: {'auction_closing_time': 1774884592.0, 'created_time': 1774773327.731981, 'last_price_update_time': 1774871005.022246}
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP17314') HTTP/1.1" 204 0
2026-03-30 11:43:25 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-30 11:43:25 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-30 11:43:25 [auto1.be] INFO: Scrape type for WT61211: 2
2026-03-30 11:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-30 11:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30daaf8d-606c-5ac5-8040-d105e29dfbfc with scrape type 2
2026-03-30 11:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30daaf8d-606c-5ac5-8040-d105e29dfbfc with scrape type 2
2026-03-30 11:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30daaf8d-606c-5ac5-8040-d105e29dfbfc, identifier: WT61211
2026-03-30 11:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-30 11:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-30 11:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211 to the API
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:57Z',
 'fuel_type': 'diesel',
 'id': '30daaf8d-606c-5ac5-8040-d105e29dfbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT61211',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 173096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-30 11:43:25 [auto1.be] INFO: Saving data for WT61211: {'auction_closing_time': 1774883517.0, 'created_time': 1773301688.620937, 'last_price_update_time': 1774871005.465889}
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT61211') HTTP/1.1" 204 0
2026-03-30 11:43:25 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-30 11:43:25 [auto1.be] INFO: Scrape type for RG41014: 2
2026-03-30 11:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014
2026-03-30 11:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0be5a3a9-0343-59dd-a02a-ee162047992c with scrape type 2
2026-03-30 11:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0be5a3a9-0343-59dd-a02a-ee162047992c with scrape type 2
2026-03-30 11:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0be5a3a9-0343-59dd-a02a-ee162047992c, identifier: RG41014
2026-03-30 11:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 11:43:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014
2026-03-30 11:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014 to the API
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:21:10Z',
 'fuel_type': 'petrol',
 'id': '0be5a3a9-0343-59dd-a02a-ee162047992c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG41014',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 46867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-27',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST X',
 'transmission': 'automatic',
 'trim': 'ST X',
 'year': 2022}
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-30 11:43:26 [auto1.be] INFO: Saving data for RG41014: {'auction_closing_time': 1774884070.0, 'created_time': 1774773325.870237, 'last_price_update_time': 1774871006.042674}
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RG41014') HTTP/1.1" 204 0
2026-03-30 11:43:26 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-30 11:43:26 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-30 11:43:26 [auto1.be] INFO: Scrape type for PH78267: 2
2026-03-30 11:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-30 11:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4694cb80-4835-5f89-beaf-7a86c80e548b with scrape type 2
2026-03-30 11:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4694cb80-4835-5f89-beaf-7a86c80e548b with scrape type 2
2026-03-30 11:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4694cb80-4835-5f89-beaf-7a86c80e548b, identifier: PH78267
2026-03-30 11:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-30 11:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-30 11:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267 to the API
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:45Z',
 'fuel_type': 'diesel',
 'id': '4694cb80-4835-5f89-beaf-7a86c80e548b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH78267',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Epica',
 'odometer': 235028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Chevrolet Epica 2.0 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2009}
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-30 11:43:26 [auto1.be] INFO: Saving data for PH78267: {'auction_closing_time': 1774884585.0, 'created_time': 1773134610.20965, 'last_price_update_time': 1774871006.462346}
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH78267') HTTP/1.1" 204 0
2026-03-30 11:43:26 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-30 11:43:26 [auto1.be] INFO: Scrape type for GA47341: 2
2026-03-30 11:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341
2026-03-30 11:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27f0fab-3eed-589d-aa11-12ad59d32e4b with scrape type 2
2026-03-30 11:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a27f0fab-3eed-589d-aa11-12ad59d32e4b with scrape type 2
2026-03-30 11:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a27f0fab-3eed-589d-aa11-12ad59d32e4b, identifier: GA47341
2026-03-30 11:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341
2026-03-30 11:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341
2026-03-30 11:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341 to the API
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'petrol',
 'id': 'a27f0fab-3eed-589d-aa11-12ad59d32e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA47341',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 120755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Renault Laguna 1.6 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2007}
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-30 11:43:26 [auto1.be] INFO: Saving data for GA47341: {'auction_closing_time': 1774883455.0, 'created_time': 1773434262.121472, 'last_price_update_time': 1774871006.957371}
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA47341') HTTP/1.1" 204 0
2026-03-30 11:43:26 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-30 11:43:26 [auto1.be] INFO: Scrape type for NL54460: 2
2026-03-30 11:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460
2026-03-30 11:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8029a219-edc3-5dfa-a882-0238d604fcb2 with scrape type 2
2026-03-30 11:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8029a219-edc3-5dfa-a882-0238d604fcb2 with scrape type 2
2026-03-30 11:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8029a219-edc3-5dfa-a882-0238d604fcb2, identifier: NL54460
2026-03-30 11:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460
2026-03-30 11:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460
2026-03-30 11:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460 to the API
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'diesel',
 'id': '8029a219-edc3-5dfa-a882-0238d604fcb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL54460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-13',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-30 11:43:27 [auto1.be] INFO: Saving data for NL54460: {'auction_closing_time': 1774883890.0, 'created_time': 1774557097.104965, 'last_price_update_time': 1774871007.346156}
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NL54460') HTTP/1.1" 204 0
2026-03-30 11:43:27 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-30 11:43:27 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-30 11:43:27 [auto1.be] INFO: Scrape type for MM05603: 2
2026-03-30 11:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603
2026-03-30 11:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd425d4c-1f37-533a-a79d-b659780a3a9a with scrape type 2
2026-03-30 11:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd425d4c-1f37-533a-a79d-b659780a3a9a with scrape type 2
2026-03-30 11:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd425d4c-1f37-533a-a79d-b659780a3a9a, identifier: MM05603
2026-03-30 11:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603
2026-03-30 11:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603
2026-03-30 11:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603 to the API
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:14:01Z',
 'fuel_type': 'petrol',
 'id': 'fd425d4c-1f37-533a-a79d-b659780a3a9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM05603',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 34480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'Land Rover Evoque P200 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-30 11:43:27 [auto1.be] INFO: Saving data for MM05603: {'auction_closing_time': 1774883641.0, 'created_time': 1774773328.060415, 'last_price_update_time': 1774871007.738183}
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MM05603') HTTP/1.1" 204 0
2026-03-30 11:43:27 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-30 11:43:27 [auto1.be] INFO: Scrape type for MT15926: 2
2026-03-30 11:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926
2026-03-30 11:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f50dee16-e552-5d9f-b7a5-69f6c1512996 with scrape type 2
2026-03-30 11:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f50dee16-e552-5d9f-b7a5-69f6c1512996 with scrape type 2
2026-03-30 11:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f50dee16-e552-5d9f-b7a5-69f6c1512996, identifier: MT15926
2026-03-30 11:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926
2026-03-30 11:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926
2026-03-30 11:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926 to the API
2026-03-30 11:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'diesel',
 'id': 'f50dee16-e552-5d9f-b7a5-69f6c1512996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT15926',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-02',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-30 11:43:28 [auto1.be] INFO: Saving data for MT15926: {'auction_closing_time': 1774885299.0, 'created_time': 1774557187.930898, 'last_price_update_time': 1774871008.132972}
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MT15926') HTTP/1.1" 204 0
2026-03-30 11:43:28 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-30 11:43:28 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-30 11:43:28 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 11:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:31 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1759 | hits on page: 40
2026-03-30 11:43:31 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 11:43:31 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-30 11:43:31 [auto1.be] INFO: Scrape type for GB86339: 2
2026-03-30 11:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339
2026-03-30 11:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with scrape type 2
2026-03-30 11:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with scrape type 2
2026-03-30 11:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91, identifier: GB86339
2026-03-30 11:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339
2026-03-30 11:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339
2026-03-30 11:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339 to the API
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:26Z',
 'fuel_type': 'petrol',
 'id': '95a1edc5-c4b8-5ff7-8144-fc66491c6a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB86339',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 14968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-16',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2023}
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-30 11:43:31 [auto1.be] INFO: Saving data for GB86339: {'auction_closing_time': 1774885646.0, 'created_time': 1773225257.711828, 'last_price_update_time': 1774871011.840092}
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB86339') HTTP/1.1" 204 0
2026-03-30 11:43:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:31 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-30 11:43:31 [auto1.be] INFO: Scrape type for PW41553: 2
2026-03-30 11:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553
2026-03-30 11:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e10d93-bd83-539a-8855-fccf46f4fef0 with scrape type 2
2026-03-30 11:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e10d93-bd83-539a-8855-fccf46f4fef0 with scrape type 2
2026-03-30 11:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75e10d93-bd83-539a-8855-fccf46f4fef0, identifier: PW41553
2026-03-30 11:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553
2026-03-30 11:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553
2026-03-30 11:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553 to the API
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:40Z',
 'fuel_type': 'petrol',
 'id': '75e10d93-bd83-539a-8855-fccf46f4fef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW41553',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 17493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-15',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2023}
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-30 11:43:32 [auto1.be] INFO: Saving data for PW41553: {'auction_closing_time': 1774884040.0, 'created_time': 1773132023.837801, 'last_price_update_time': 1774871012.326482}
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PW41553') HTTP/1.1" 204 0
2026-03-30 11:43:32 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-30 11:43:32 [auto1.be] INFO: Scrape type for FF69776: 2
2026-03-30 11:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-30 11:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-30 11:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-30 11:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f01f9a6-2504-51a9-9159-c4055b50959b, identifier: FF69776
2026-03-30 11:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-30 11:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-30 11:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776 to the API
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:15Z',
 'fuel_type': 'diesel',
 'id': '8f01f9a6-2504-51a9-9159-c4055b50959b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF69776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 86505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 R-Dynamic AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic AWD',
 'year': 2020}
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-30 11:43:32 [auto1.be] INFO: Saving data for FF69776: {'auction_closing_time': 1774884795.0, 'created_time': 1773132813.305858, 'last_price_update_time': 1774871012.882746}
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF69776') HTTP/1.1" 204 0
2026-03-30 11:43:32 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-30 11:43:32 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-30 11:43:32 [auto1.be] INFO: Scrape type for YH64614: 2
2026-03-30 11:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614
2026-03-30 11:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28fd5560-64b4-5cff-9cfa-22115130cecc with scrape type 2
2026-03-30 11:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28fd5560-64b4-5cff-9cfa-22115130cecc with scrape type 2
2026-03-30 11:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28fd5560-64b4-5cff-9cfa-22115130cecc, identifier: YH64614
2026-03-30 11:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS23532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614
2026-03-30 11:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614
2026-03-30 11:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614 to the API
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'diesel',
 'id': '28fd5560-64b4-5cff-9cfa-22115130cecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH64614',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 91179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-30 11:43:33 [auto1.be] INFO: Saving data for YH64614: {'auction_closing_time': 1774884355.0, 'created_time': 1773132221.331095, 'last_price_update_time': 1774871013.303009}
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH64614') HTTP/1.1" 204 0
2026-03-30 11:43:33 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-30 11:43:33 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-30 11:43:33 [auto1.be] INFO: Scrape type for BT87712: 2
2026-03-30 11:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712
2026-03-30 11:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4feaf73-53d6-5efa-a018-230e3e36b8b5 with scrape type 2
2026-03-30 11:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4feaf73-53d6-5efa-a018-230e3e36b8b5 with scrape type 2
2026-03-30 11:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4feaf73-53d6-5efa-a018-230e3e36b8b5, identifier: BT87712
2026-03-30 11:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712
2026-03-30 11:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712
2026-03-30 11:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712 to the API
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:59Z',
 'fuel_type': 'diesel',
 'id': 'e4feaf73-53d6-5efa-a018-230e3e36b8b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT87712',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 236633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-30 11:43:34 [auto1.be] INFO: Saving data for BT87712: {'auction_closing_time': 1774884959.0, 'created_time': 1773301844.868209, 'last_price_update_time': 1774871014.039494}
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT87712') HTTP/1.1" 204 0
2026-03-30 11:43:34 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-30 11:43:34 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-30 11:43:34 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-30 11:43:34 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-30 11:43:34 [auto1.be] INFO: Scrape type for NC51382: 2
2026-03-30 11:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382
2026-03-30 11:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f18fee-f091-5ed3-a700-32a7889884b5 with scrape type 2
2026-03-30 11:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23f18fee-f091-5ed3-a700-32a7889884b5 with scrape type 2
2026-03-30 11:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23f18fee-f091-5ed3-a700-32a7889884b5, identifier: NC51382
2026-03-30 11:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382
2026-03-30 11:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382
2026-03-30 11:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382 to the API
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:01:39Z',
 'fuel_type': 'hybrid',
 'id': '23f18fee-f091-5ed3-a700-32a7889884b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC51382',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 61733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 Hybrid Style 2WD',
 'transmission': 'automatic',
 'trim': 'Style 2WD',
 'year': 2020}
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-30 11:43:34 [auto1.be] INFO: Saving data for NC51382: {'auction_closing_time': 1774882899.0, 'created_time': 1773133887.637821, 'last_price_update_time': 1774871014.455031}
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC51382') HTTP/1.1" 204 0
2026-03-30 11:43:34 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-30 11:43:34 [auto1.be] INFO: Scrape type for XU40393: 2
2026-03-30 11:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-30 11:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac89b154-77ed-54a0-ad45-c771c34bd66c with scrape type 2
2026-03-30 11:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac89b154-77ed-54a0-ad45-c771c34bd66c with scrape type 2
2026-03-30 11:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac89b154-77ed-54a0-ad45-c771c34bd66c, identifier: XU40393
2026-03-30 11:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-30 11:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-30 11:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393 to the API
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:59Z',
 'fuel_type': 'petrol',
 'id': 'ac89b154-77ed-54a0-ad45-c771c34bd66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU40393',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 83337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2020}
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-30 11:43:34 [auto1.be] INFO: Saving data for XU40393: {'auction_closing_time': 1774882859.0, 'created_time': 1774298144.853249, 'last_price_update_time': 1774871014.908857}
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU40393') HTTP/1.1" 204 0
2026-03-30 11:43:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:34 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-30 11:43:34 [auto1.be] INFO: Scrape type for JU27695: 2
2026-03-30 11:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695
2026-03-30 11:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885710b9-2165-5825-879e-5964b9e758b8 with scrape type 2
2026-03-30 11:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 885710b9-2165-5825-879e-5964b9e758b8 with scrape type 2
2026-03-30 11:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 885710b9-2165-5825-879e-5964b9e758b8, identifier: JU27695
2026-03-30 11:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695
2026-03-30 11:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695
2026-03-30 11:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695 to the API
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:35:49Z',
 'fuel_type': 'diesel',
 'id': '885710b9-2165-5825-879e-5964b9e758b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU27695',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 231724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-30 11:43:35 [auto1.be] INFO: Saving data for JU27695: {'auction_closing_time': 1774884949.0, 'created_time': 1773132941.63354, 'last_price_update_time': 1774871015.352544}
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU27695') HTTP/1.1" 204 0
2026-03-30 11:43:35 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-30 11:43:35 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-30 11:43:35 [auto1.be] INFO: Scrape type for FH50113: 2
2026-03-30 11:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-30 11:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e45de4-37f4-506a-974d-f4c70084e437 with scrape type 2
2026-03-30 11:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e45de4-37f4-506a-974d-f4c70084e437 with scrape type 2
2026-03-30 11:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61e45de4-37f4-506a-974d-f4c70084e437, identifier: FH50113
2026-03-30 11:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-30 11:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-30 11:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113 to the API
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': '61e45de4-37f4-506a-974d-f4c70084e437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH50113',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 65446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-30 11:43:35 [auto1.be] INFO: Saving data for FH50113: {'auction_closing_time': 1774885866.0, 'created_time': 1773133772.464527, 'last_price_update_time': 1774871015.844076}
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH50113') HTTP/1.1" 204 0
2026-03-30 11:43:35 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-30 11:43:35 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-30 11:43:35 [auto1.be] INFO: Scrape type for JC67757: 2
2026-03-30 11:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757
2026-03-30 11:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with scrape type 2
2026-03-30 11:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with scrape type 2
2026-03-30 11:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7, identifier: JC67757
2026-03-30 11:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757
2026-03-30 11:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757
2026-03-30 11:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757 to the API
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:13:35Z',
 'fuel_type': 'diesel',
 'id': 'e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC67757',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 88121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [auto1.be] INFO: Saving data for JC67757: {'auction_closing_time': 1774883615.0, 'created_time': 1773349266.991987, 'last_price_update_time': 1774871016.260036}
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC67757') HTTP/1.1" 204 0
2026-03-30 11:43:36 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [auto1.be] INFO: Scrape type for VM31149: 2
2026-03-30 11:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149
2026-03-30 11:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2db8937-57de-5fe8-b9c5-ee869f0aec3f with scrape type 2
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2db8937-57de-5fe8-b9c5-ee869f0aec3f with scrape type 2
2026-03-30 11:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2db8937-57de-5fe8-b9c5-ee869f0aec3f, identifier: VM31149
2026-03-30 11:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149
2026-03-30 11:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149
2026-03-30 11:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149 to the API
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:57:26Z',
 'fuel_type': 'petrol',
 'id': 'a2db8937-57de-5fe8-b9c5-ee869f0aec3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM31149',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 52659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-22',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [auto1.be] INFO: Saving data for VM31149: {'auction_closing_time': 1774886246.0, 'created_time': 1773137257.010958, 'last_price_update_time': 1774871016.686034}
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM31149') HTTP/1.1" 204 0
2026-03-30 11:43:36 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-30 11:43:36 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-30 11:43:36 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-30 11:43:36 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-30 11:43:36 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-30 11:43:36 [auto1.be] INFO: Scrape type for DY35896: 2
2026-03-30 11:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896
2026-03-30 11:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef131b08-327c-5aa4-ac06-ff22198c1b06 with scrape type 2
2026-03-30 11:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef131b08-327c-5aa4-ac06-ff22198c1b06 with scrape type 2
2026-03-30 11:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef131b08-327c-5aa4-ac06-ff22198c1b06, identifier: DY35896
2026-03-30 11:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896
2026-03-30 11:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896
2026-03-30 11:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896 to the API
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:02Z',
 'fuel_type': 'petrol',
 'id': 'ef131b08-327c-5aa4-ac06-ff22198c1b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY35896',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Carisma',
 'odometer': 102060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-06-03',
 'seller_name': None,
 'title': 'Mitsubishi Carisma 1.8 GDI EXE',
 'transmission': 'manual',
 'trim': 'EXE',
 'year': 1999}
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-30 11:43:37 [auto1.be] INFO: Saving data for DY35896: {'auction_closing_time': 1774884242.0, 'created_time': 1774773333.622127, 'last_price_update_time': 1774871017.107743}
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY35896') HTTP/1.1" 204 0
2026-03-30 11:43:37 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-30 11:43:37 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-30 11:43:37 [auto1.be] INFO: Scrape type for VM01272: 2
2026-03-30 11:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272
2026-03-30 11:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with scrape type 2
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with scrape type 2
2026-03-30 11:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03cbc889-708d-5c6c-b63f-11ffbe2cd065, identifier: VM01272
2026-03-30 11:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272
2026-03-30 11:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272
2026-03-30 11:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272 to the API
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:56Z',
 'fuel_type': 'diesel',
 'id': '03cbc889-708d-5c6c-b63f-11ffbe2cd065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM01272',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 101316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-30 11:43:37 [auto1.be] INFO: Saving data for VM01272: {'auction_closing_time': 1774883036.0, 'created_time': 1774773333.943198, 'last_price_update_time': 1774871017.522658}
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM01272') HTTP/1.1" 204 0
2026-03-30 11:43:37 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-30 11:43:37 [auto1.be] INFO: Scrape type for KL42374: 2
2026-03-30 11:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-30 11:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with scrape type 2
2026-03-30 11:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with scrape type 2
2026-03-30 11:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50, identifier: KL42374
2026-03-30 11:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-30 11:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-30 11:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374 to the API
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:16:09Z',
 'fuel_type': 'diesel',
 'id': 'ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL42374',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Ghibli',
 'odometer': 126833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Maserati Ghibli 3.0 V6 Diesel Gran Sport',
 'transmission': 'automatic',
 'trim': 'Gran Sport',
 'year': 2018}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-30 11:43:38 [auto1.be] INFO: Saving data for KL42374: {'auction_closing_time': 1774883769.0, 'created_time': 1774643456.198216, 'last_price_update_time': 1774871018.018183}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL42374') HTTP/1.1" 204 0
2026-03-30 11:43:38 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-30 11:43:38 [auto1.be] INFO: Scrape type for UF75491: 2
2026-03-30 11:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-30 11:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d5c763-c727-54ba-a535-c23725c647f6 with scrape type 2
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31d5c763-c727-54ba-a535-c23725c647f6 with scrape type 2
2026-03-30 11:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31d5c763-c727-54ba-a535-c23725c647f6, identifier: UF75491
2026-03-30 11:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS23532> (referer: https://www.auto1.com/v1/car-details-view/YS23532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-30 11:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-30 11:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491 to the API
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:47Z',
 'fuel_type': 'diesel',
 'id': '31d5c763-c727-54ba-a535-c23725c647f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF75491',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 212924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-30 11:43:38 [auto1.be] INFO: Saving data for UF75491: {'auction_closing_time': 1774886207.0, 'created_time': 1773133264.509273, 'last_price_update_time': 1774871018.444826}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF75491') HTTP/1.1" 204 0
2026-03-30 11:43:38 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-30 11:43:38 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-30 11:43:38 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-30 11:43:38 [auto1.be] INFO: Scrape type for EL71552: 2
2026-03-30 11:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552
2026-03-30 11:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d749a67-a5b3-5c03-8979-33e82d662694 with scrape type 2
2026-03-30 11:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d749a67-a5b3-5c03-8979-33e82d662694 with scrape type 2
2026-03-30 11:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d749a67-a5b3-5c03-8979-33e82d662694, identifier: EL71552
2026-03-30 11:43:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX41608> (referer: https://www.auto1.com/v1/car-details-view/EX41608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552
2026-03-30 11:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552
2026-03-30 11:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552 to the API
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:44Z',
 'fuel_type': 'petrol',
 'id': '0d749a67-a5b3-5c03-8979-33e82d662694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL71552',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 183139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-30 11:43:38 [auto1.be] INFO: Saving data for EL71552: {'auction_closing_time': 1774884404.0, 'created_time': 1773133233.497316, 'last_price_update_time': 1774871018.986009}
2026-03-30 11:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL71552') HTTP/1.1" 204 0
2026-03-30 11:43:39 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [auto1.be] INFO: Scrape type for SK78967: 2
2026-03-30 11:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967
2026-03-30 11:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3445d87-79fb-52d7-be15-5882fef0d262 with scrape type 2
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3445d87-79fb-52d7-be15-5882fef0d262 with scrape type 2
2026-03-30 11:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3445d87-79fb-52d7-be15-5882fef0d262, identifier: SK78967
2026-03-30 11:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967
2026-03-30 11:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967
2026-03-30 11:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967 to the API
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:14Z',
 'fuel_type': 'diesel',
 'id': 'f3445d87-79fb-52d7-be15-5882fef0d262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK78967',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 180334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [auto1.be] INFO: Saving data for SK78967: {'auction_closing_time': 1774884674.0, 'created_time': 1773134804.365513, 'last_price_update_time': 1774871019.438297}
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK78967') HTTP/1.1" 204 0
2026-03-30 11:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7bc4389-ff67-54b8-9306-100f239c7c6f with identifier: YS23532
2026-03-30 11:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7bc4389-ff67-54b8-9306-100f239c7c6f with scrape type 1
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_47722a52d5263e6b0af64f6e37ded7c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_47722a52d5263e6b0af64f6e37ded7c2.jpg not downloaded yet
2026-03-30 11:43:39 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [auto1.be] INFO: Scrape type for TG30379: 2
2026-03-30 11:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379
2026-03-30 11:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3d86b2-2ccb-5bea-b032-780e3f253e78 with scrape type 2
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa3d86b2-2ccb-5bea-b032-780e3f253e78 with scrape type 2
2026-03-30 11:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa3d86b2-2ccb-5bea-b032-780e3f253e78, identifier: TG30379
2026-03-30 11:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379
2026-03-30 11:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379
2026-03-30 11:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379 to the API
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:10Z',
 'fuel_type': 'diesel',
 'id': 'fa3d86b2-2ccb-5bea-b032-780e3f253e78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG30379',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 208607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 313 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [auto1.be] INFO: Saving data for TG30379: {'auction_closing_time': 1774885210.0, 'created_time': 1773132090.618136, 'last_price_update_time': 1774871019.892987}
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TG30379') HTTP/1.1" 204 0
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_7b1d8603b82f37d3ace402a50d8651ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_7b1d8603b82f37d3ace402a50d8651ab.jpg not downloaded yet
2026-03-30 11:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 with identifier: EX41608
2026-03-30 11:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 with scrape type 1
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg not downloaded yet
2026-03-30 11:43:39 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-30 11:43:39 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-30 11:43:39 [auto1.be] INFO: Scrape type for DB21184: 2
2026-03-30 11:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-30 11:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with scrape type 2
2026-03-30 11:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with scrape type 2
2026-03-30 11:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 810a8a59-f990-5c63-bb42-8f748f7ec3d9, identifier: DB21184
2026-03-30 11:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-30 11:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-30 11:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184 to the API
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'diesel',
 'id': '810a8a59-f990-5c63-bb42-8f748f7ec3d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB21184',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 145380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'BMW X2 sDrive 16d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2019}
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [auto1.be] INFO: Saving data for DB21184: {'auction_closing_time': 1774884616.0, 'created_time': 1773137053.882676, 'last_price_update_time': 1774871020.356084}
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB21184') HTTP/1.1" 204 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_baf2ce733692e1e237e7f35212152a81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_baf2ce733692e1e237e7f35212152a81.jpg not downloaded yet
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_2d9bf4f5d46aa416921c0c912ff8952e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_2d9bf4f5d46aa416921c0c912ff8952e.jpg not downloaded yet
2026-03-30 11:43:40 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-30 11:43:40 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-30 11:43:40 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-30 11:43:40 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-30 11:43:40 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_284bb4f0e53dfc39e668e6c92c430168.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_284bb4f0e53dfc39e668e6c92c430168.jpg not downloaded yet
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_14f4bcfe13bd5c45bba5f38698a9b5cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_14f4bcfe13bd5c45bba5f38698a9b5cb.jpg not downloaded yet
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_47722a52d5263e6b0af64f6e37ded7c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_385f5b3a142da74a452b5f8f824b2032.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_385f5b3a142da74a452b5f8f824b2032.jpg not downloaded yet
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_f04889139b88fc33ece3edfd22869c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_f04889139b88fc33ece3edfd22869c3b.jpg not downloaded yet
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_84b0a0f0aa6694e035fdf88bbcc100e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_84b0a0f0aa6694e035fdf88bbcc100e2.jpg not downloaded yet
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_590ea8f4f16d0b90cb49042070644a75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_590ea8f4f16d0b90cb49042070644a75.jpg not downloaded yet
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_7b1d8603b82f37d3ace402a50d8651ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_cc4864fa86be542cd30114aaf0e5c695.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_cc4864fa86be542cd30114aaf0e5c695.jpg not downloaded yet
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_baf2ce733692e1e237e7f35212152a81.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_a2e192ceec770f0d8f996bee3f0eaadc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_a2e192ceec770f0d8f996bee3f0eaadc.jpg not downloaded yet
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_2d9bf4f5d46aa416921c0c912ff8952e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_778b16462eddf19e9c08cc8b8a68bba5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_778b16462eddf19e9c08cc8b8a68bba5.jpg not downloaded yet
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_f04889139b88fc33ece3edfd22869c3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_284bb4f0e53dfc39e668e6c92c430168.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_36d4ad3b2274d442760ed9c5ec23320f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_36d4ad3b2274d442760ed9c5ec23320f.jpg not downloaded yet
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e969efd0>
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_47722a52d5263e6b0af64f6e37ded7c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_47722a52d5263e6b0af64f6e37ded7c2.jpg saved to cache
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_14f4bcfe13bd5c45bba5f38698a9b5cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_c0fdae8b77e17e6cb9191cf3b654d3c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_c0fdae8b77e17e6cb9191cf3b654d3c8.jpg not downloaded yet
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_590ea8f4f16d0b90cb49042070644a75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_84b0a0f0aa6694e035fdf88bbcc100e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e98261d0>
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_7b1d8603b82f37d3ace402a50d8651ab.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_7b1d8603b82f37d3ace402a50d8651ab.jpg saved to cache
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95b58d0>
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_baf2ce733692e1e237e7f35212152a81.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_baf2ce733692e1e237e7f35212152a81.jpg saved to cache
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_cc4864fa86be542cd30114aaf0e5c695.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e95c2a50>
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_2d9bf4f5d46aa416921c0c912ff8952e.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_2d9bf4f5d46aa416921c0c912ff8952e.jpg saved to cache
2026-03-30 11:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_a2e192ceec770f0d8f996bee3f0eaadc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_778b16462eddf19e9c08cc8b8a68bba5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e976dfd0>
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_f04889139b88fc33ece3edfd22869c3b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_f04889139b88fc33ece3edfd22869c3b.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b2f50>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_284bb4f0e53dfc39e668e6c92c430168.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_284bb4f0e53dfc39e668e6c92c430168.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e96e4150>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_14f4bcfe13bd5c45bba5f38698a9b5cb.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_14f4bcfe13bd5c45bba5f38698a9b5cb.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97b3b90>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_590ea8f4f16d0b90cb49042070644a75.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_590ea8f4f16d0b90cb49042070644a75.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9774910>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_84b0a0f0aa6694e035fdf88bbcc100e2.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_84b0a0f0aa6694e035fdf88bbcc100e2.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9816b90>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_cc4864fa86be542cd30114aaf0e5c695.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_cc4864fa86be542cd30114aaf0e5c695.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_36d4ad3b2274d442760ed9c5ec23320f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_c0fdae8b77e17e6cb9191cf3b654d3c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_385f5b3a142da74a452b5f8f824b2032.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ebff7fd0>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_a2e192ceec770f0d8f996bee3f0eaadc.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_a2e192ceec770f0d8f996bee3f0eaadc.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e979c910>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_778b16462eddf19e9c08cc8b8a68bba5.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_778b16462eddf19e9c08cc8b8a68bba5.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e1850>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_36d4ad3b2274d442760ed9c5ec23320f.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_36d4ad3b2274d442760ed9c5ec23320f.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e963a7d0>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_c0fdae8b77e17e6cb9191cf3b654d3c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_c0fdae8b77e17e6cb9191cf3b654d3c8.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec4dae10>
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F26%252Fab26bf5341e2324c47fda3b51bd5388d%252Fpa%252FYS23532_385f5b3a142da74a452b5f8f824b2032.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_385f5b3a142da74a452b5f8f824b2032.jpg saved to cache
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7bc4389-ff67-54b8-9306-100f239c7c6f
2026-03-30 11:43:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7bc4389-ff67-54b8-9306-100f239c7c6f, skipping ID generation
2026-03-30 11:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7bc4389-ff67-54b8-9306-100f239c7c6f with scrape type 1
2026-03-30 11:43:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7bc4389-ff67-54b8-9306-100f239c7c6f sending to next pipeline
2026-03-30 11:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7bc4389-ff67-54b8-9306-100f239c7c6f, identifier: YS23532
2026-03-30 11:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7bc4389-ff67-54b8-9306-100f239c7c6f with identifier: YS23532
2026-03-30 11:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7bc4389-ff67-54b8-9306-100f239c7c6f with identifier: YS23532
2026-03-30 11:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7bc4389-ff67-54b8-9306-100f239c7c6f with identifier: YS23532 to the API
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_385f5b3a142da74a452b5f8f824b2032.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:38:25Z',
 'fuel_type': 'petrol',
 'id': 'b7bc4389-ff67-54b8-9306-100f239c7c6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS23532',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 117463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_47722a52d5263e6b0af64f6e37ded7c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_7b1d8603b82f37d3ace402a50d8651ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_baf2ce733692e1e237e7f35212152a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_284bb4f0e53dfc39e668e6c92c430168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_385f5b3a142da74a452b5f8f824b2032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7bc4389-ff67-54b8-9306-100f239c7c6f/b7bc4389-ff67-54b8-9306-100f239c7c6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/26/ab26bf5341e2324c47fda3b51bd5388d/pa/YS23532_84b0a0f0aa6694e035fdf88bbcc100e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2011}
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23532%27 HTTP/1.1" 200 None
2026-03-30 11:43:42 [auto1.be] INFO: Saving data for YS23532: {'created_time': 1774871022.080587, 'last_price_update_time': 1774871022.080599, 'auction_closing_time': 1774971505.0}
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS23532') HTTP/1.1" 204 0
2026-03-30 11:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:43:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:43:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:43:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:43:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:43:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2de3d0>
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:43:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4c%252Ffc4ce4f1ef6aadfded70361bf91f3fb5%252Fpa%252FEX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg') HTTP/1.1" 204 0
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg saved to cache
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029
2026-03-30 11:43:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1de4f2a7-ad40-5628-a0ff-8049f7c2a029, skipping ID generation
2026-03-30 11:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 with scrape type 1
2026-03-30 11:43:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 sending to next pipeline
2026-03-30 11:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1de4f2a7-ad40-5628-a0ff-8049f7c2a029, identifier: EX41608
2026-03-30 11:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 with identifier: EX41608
2026-03-30 11:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 with identifier: EX41608
2026-03-30 11:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1de4f2a7-ad40-5628-a0ff-8049f7c2a029 with identifier: EX41608 to the API
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:36:40Z',
 'fuel_type': 'diesel',
 'id': '1de4f2a7-ad40-5628-a0ff-8049f7c2a029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX41608',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 94311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4262312,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_ab40767c25a7889aaaddf5dd693ec16b.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_2d9bf4f5d46aa416921c0c912ff8952e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_14f4bcfe13bd5c45bba5f38698a9b5cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_f04889139b88fc33ece3edfd22869c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_590ea8f4f16d0b90cb49042070644a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_cc4864fa86be542cd30114aaf0e5c695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_a2e192ceec770f0d8f996bee3f0eaadc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_778b16462eddf19e9c08cc8b8a68bba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_36d4ad3b2274d442760ed9c5ec23320f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1de4f2a7-ad40-5628-a0ff-8049f7c2a029/1de4f2a7-ad40-5628-a0ff-8049f7c2a029_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4c/fc4ce4f1ef6aadfded70361bf91f3fb5/pa/EX41608_c0fdae8b77e17e6cb9191cf3b654d3c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Audi A6 Allroad 45 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX41608%27 HTTP/1.1" 200 None
2026-03-30 11:43:42 [auto1.be] INFO: Saving data for EX41608: {'created_time': 1774871022.904729, 'last_price_update_time': 1774871022.904741, 'auction_closing_time': 1774971400.0}
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX41608') HTTP/1.1" 204 0
2026-03-30 11:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP64543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN71185> (referer: https://www.auto1.com/v1/car-details-view/AN71185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd with identifier: AN71185
2026-03-30 11:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd with scrape type 1
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_0b0e9c750eec0a391a08caf0eef73e0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_0b0e9c750eec0a391a08caf0eef73e0c.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_c6d1cafc74b2473a2c03b53063124afc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_c6d1cafc74b2473a2c03b53063124afc.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_a9467fd4f5a9f8f5d673ce70d1622f26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_a9467fd4f5a9f8f5d673ce70d1622f26.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_9571b52cbe7c0d8a0c90f5c596fd6997.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_9571b52cbe7c0d8a0c90f5c596fd6997.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_17e3b23cced41b59040fb544cadb738b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_17e3b23cced41b59040fb544cadb738b.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_44889d34c8279c13caef16f06e04db46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_44889d34c8279c13caef16f06e04db46.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_9a5381f08bab7f85a95acffa60c1e42c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_9a5381f08bab7f85a95acffa60c1e42c.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_dda1568392e5d2a8cae5f8f856a6bda0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_dda1568392e5d2a8cae5f8f856a6bda0.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_5833b4ad6da886177cb5ffe1f1e243a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_5833b4ad6da886177cb5ffe1f1e243a4.jpg already downloaded
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F0b%252F170bd6959d8c42b9480326912fea6a25%252Fpa%252FAN71185_1d2dc4e9e5cce203ff8ac176668fbcd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_1d2dc4e9e5cce203ff8ac176668fbcd8.jpg already downloaded
2026-03-30 11:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd, identifier: AN71185
2026-03-30 11:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd with identifier: AN71185
2026-03-30 11:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd with identifier: AN71185
2026-03-30 11:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd with identifier: AN71185 to the API
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN71185>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-03-31T15:04:20Z',
 'fuel_type': 'petrol',
 'id': 'd8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN71185',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 86771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_0b0e9c750eec0a391a08caf0eef73e0c.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_c6d1cafc74b2473a2c03b53063124afc.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_a9467fd4f5a9f8f5d673ce70d1622f26.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_9571b52cbe7c0d8a0c90f5c596fd6997.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_17e3b23cced41b59040fb544cadb738b.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_44889d34c8279c13caef16f06e04db46.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_9a5381f08bab7f85a95acffa60c1e42c.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_dda1568392e5d2a8cae5f8f856a6bda0.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_5833b4ad6da886177cb5ffe1f1e243a4.jpg',
                'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_1d2dc4e9e5cce203ff8ac176668fbcd8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_0b0e9c750eec0a391a08caf0eef73e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_c6d1cafc74b2473a2c03b53063124afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_a9467fd4f5a9f8f5d673ce70d1622f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_9571b52cbe7c0d8a0c90f5c596fd6997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_17e3b23cced41b59040fb544cadb738b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_44889d34c8279c13caef16f06e04db46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_9a5381f08bab7f85a95acffa60c1e42c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_dda1568392e5d2a8cae5f8f856a6bda0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_5833b4ad6da886177cb5ffe1f1e243a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd/d8cc9fe2-08ad-5a0f-bbd6-0c0ce35caabd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/0b/170bd6959d8c42b9480326912fea6a25/pa/AN71185_1d2dc4e9e5cce203ff8ac176668fbcd8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2021}
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN71185%27 HTTP/1.1" 200 None
2026-03-30 11:43:51 [auto1.be] INFO: Saving data for AN71185: {'created_time': 1774871031.65661, 'last_price_update_time': 1774871031.65662, 'auction_closing_time': 1774969460.0}
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AN71185') HTTP/1.1" 204 0
2026-03-30 11:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:54 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1759 | hits on page: 40
2026-03-30 11:43:54 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-30 11:43:54 [auto1.be] INFO: Scrape type for EA40127: 2
2026-03-30 11:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127
2026-03-30 11:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with scrape type 2
2026-03-30 11:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with scrape type 2
2026-03-30 11:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32, identifier: EA40127
2026-03-30 11:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127
2026-03-30 11:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127
2026-03-30 11:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127 to the API
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:23:34Z',
 'fuel_type': 'petrol',
 'id': '33be8d1f-b8ba-5d66-802e-3f114b8f9f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA40127',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 84419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-30 11:43:54 [auto1.be] INFO: Saving data for EA40127: {'auction_closing_time': 1774884214.0, 'created_time': 1774773332.762408, 'last_price_update_time': 1774871034.501356}
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA40127') HTTP/1.1" 204 0
2026-03-30 11:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:54 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-30 11:43:54 [auto1.be] INFO: Scrape type for DF78239: 2
2026-03-30 11:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239
2026-03-30 11:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d163814c-326f-5b24-a2de-99ebfe1d3309 with scrape type 2
2026-03-30 11:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d163814c-326f-5b24-a2de-99ebfe1d3309 with scrape type 2
2026-03-30 11:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d163814c-326f-5b24-a2de-99ebfe1d3309, identifier: DF78239
2026-03-30 11:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239
2026-03-30 11:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239
2026-03-30 11:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239 to the API
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:30Z',
 'fuel_type': 'diesel',
 'id': 'd163814c-326f-5b24-a2de-99ebfe1d3309',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF78239',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 202956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-18',
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-30 11:43:54 [auto1.be] INFO: Saving data for DF78239: {'auction_closing_time': 1774886070.0, 'created_time': 1774773336.056211, 'last_price_update_time': 1774871034.896497}
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF78239') HTTP/1.1" 204 0
2026-03-30 11:43:54 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-30 11:43:54 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-30 11:43:54 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-30 11:43:54 [auto1.be] INFO: Scrape type for BE62996: 2
2026-03-30 11:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996
2026-03-30 11:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eae0644-0fc4-5599-9021-d8350facc148 with scrape type 2
2026-03-30 11:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eae0644-0fc4-5599-9021-d8350facc148 with scrape type 2
2026-03-30 11:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4eae0644-0fc4-5599-9021-d8350facc148, identifier: BE62996
2026-03-30 11:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996
2026-03-30 11:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996
2026-03-30 11:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996 to the API
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:40Z',
 'fuel_type': 'petrol',
 'id': '4eae0644-0fc4-5599-9021-d8350facc148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE62996',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 86259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-30 11:43:55 [auto1.be] INFO: Saving data for BE62996: {'auction_closing_time': 1774884400.0, 'created_time': 1773224103.990911, 'last_price_update_time': 1774871035.300851}
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BE62996') HTTP/1.1" 204 0
2026-03-30 11:43:55 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-30 11:43:55 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-30 11:43:55 [auto1.be] INFO: Scrape type for EL91929: 2
2026-03-30 11:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-30 11:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078a1d43-c79b-5739-8d43-253a90eb93db with scrape type 2
2026-03-30 11:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 078a1d43-c79b-5739-8d43-253a90eb93db with scrape type 2
2026-03-30 11:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 078a1d43-c79b-5739-8d43-253a90eb93db, identifier: EL91929
2026-03-30 11:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-30 11:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-30 11:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929 to the API
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:58Z',
 'fuel_type': 'petrol',
 'id': '078a1d43-c79b-5739-8d43-253a90eb93db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91929',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 96090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-30 11:43:55 [auto1.be] INFO: Saving data for EL91929: {'auction_closing_time': 1774883098.0, 'created_time': 1773134160.940849, 'last_price_update_time': 1774871035.742003}
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL91929') HTTP/1.1" 204 0
2026-03-30 11:43:55 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-30 11:43:55 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-30 11:43:55 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-30 11:43:55 [auto1.be] INFO: Scrape type for LE91648: 2
2026-03-30 11:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-30 11:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1efb1a35-4c8a-549d-941c-7eb47a31c85b with scrape type 2
2026-03-30 11:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1efb1a35-4c8a-549d-941c-7eb47a31c85b with scrape type 2
2026-03-30 11:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1efb1a35-4c8a-549d-941c-7eb47a31c85b, identifier: LE91648
2026-03-30 11:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-30 11:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-30 11:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648 to the API
2026-03-30 11:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:15Z',
 'fuel_type': 'diesel',
 'id': '1efb1a35-4c8a-549d-941c-7eb47a31c85b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE91648',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 122827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'BMW 3er 320d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-30 11:43:56 [auto1.be] INFO: Saving data for LE91648: {'auction_closing_time': 1774884795.0, 'created_time': 1773136989.3621, 'last_price_update_time': 1774871036.154051}
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE91648') HTTP/1.1" 204 0
2026-03-30 11:43:56 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-30 11:43:56 [auto1.be] INFO: Scrape type for ZZ00486: 2
2026-03-30 11:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486
2026-03-30 11:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f444d1a-c303-50e9-9816-1d529ec66b90 with scrape type 2
2026-03-30 11:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f444d1a-c303-50e9-9816-1d529ec66b90 with scrape type 2
2026-03-30 11:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f444d1a-c303-50e9-9816-1d529ec66b90, identifier: ZZ00486
2026-03-30 11:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486
2026-03-30 11:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486
2026-03-30 11:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486 to the API
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:48:42Z',
 'fuel_type': 'petrol',
 'id': '5f444d1a-c303-50e9-9816-1d529ec66b90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ00486',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 90284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-30',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.2 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2010}
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-30 11:43:56 [auto1.be] INFO: Saving data for ZZ00486: {'auction_closing_time': 1774885722.0, 'created_time': 1774773335.207569, 'last_price_update_time': 1774871036.551377}
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ00486') HTTP/1.1" 204 0
2026-03-30 11:43:56 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-30 11:43:56 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-30 11:43:56 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-30 11:43:56 [auto1.be] INFO: Scrape type for YK14398: 2
2026-03-30 11:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398
2026-03-30 11:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af1030bb-e11c-5961-bd74-3b365bf0ed3c with scrape type 2
2026-03-30 11:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af1030bb-e11c-5961-bd74-3b365bf0ed3c with scrape type 2
2026-03-30 11:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af1030bb-e11c-5961-bd74-3b365bf0ed3c, identifier: YK14398
2026-03-30 11:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398
2026-03-30 11:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398
2026-03-30 11:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398 to the API
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'diesel',
 'id': 'af1030bb-e11c-5961-bd74-3b365bf0ed3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK14398',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 169153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-30 11:43:57 [auto1.be] INFO: Saving data for YK14398: {'auction_closing_time': 1774883861.0, 'created_time': 1773301704.078089, 'last_price_update_time': 1774871037.028126}
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK14398') HTTP/1.1" 204 0
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-30 11:43:57 [auto1.be] INFO: Scrape type for FC68971: 2
2026-03-30 11:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971
2026-03-30 11:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c53946-e7ab-574c-b3da-793c735f791b with scrape type 2
2026-03-30 11:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c53946-e7ab-574c-b3da-793c735f791b with scrape type 2
2026-03-30 11:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 72c53946-e7ab-574c-b3da-793c735f791b, identifier: FC68971
2026-03-30 11:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971
2026-03-30 11:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971
2026-03-30 11:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971 to the API
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'diesel',
 'id': '72c53946-e7ab-574c-b3da-793c735f791b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC68971',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 76835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-07',
 'seller_name': None,
 'title': 'Jaguar XE 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2017}
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-30 11:43:57 [auto1.be] INFO: Saving data for FC68971: {'auction_closing_time': 1774884209.0, 'created_time': 1773136187.526546, 'last_price_update_time': 1774871037.443549}
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC68971') HTTP/1.1" 204 0
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-30 11:43:57 [auto1.be] INFO: Scrape type for TE49371: 2
2026-03-30 11:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371
2026-03-30 11:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c85f81b-58a8-5286-88b5-daf9c24becc6 with scrape type 2
2026-03-30 11:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c85f81b-58a8-5286-88b5-daf9c24becc6 with scrape type 2
2026-03-30 11:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c85f81b-58a8-5286-88b5-daf9c24becc6, identifier: TE49371
2026-03-30 11:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371
2026-03-30 11:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371
2026-03-30 11:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371 to the API
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '9c85f81b-58a8-5286-88b5-daf9c24becc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE49371',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 52383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T-GDi Longitude FWD',
 'transmission': 'automatic',
 'trim': 'Longitude FWD',
 'year': 2020}
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-30 11:43:57 [auto1.be] INFO: Saving data for TE49371: {'auction_closing_time': 1774884726.0, 'created_time': 1774773334.874826, 'last_price_update_time': 1774871037.821348}
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE49371') HTTP/1.1" 204 0
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-30 11:43:57 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-30 11:43:57 [auto1.be] INFO: Scrape type for CC34063: 2
2026-03-30 11:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063
2026-03-30 11:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with scrape type 2
2026-03-30 11:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with scrape type 2
2026-03-30 11:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3, identifier: CC34063
2026-03-30 11:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063
2026-03-30 11:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063
2026-03-30 11:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063 to the API
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:52:59Z',
 'fuel_type': 'diesel',
 'id': '2a05fbb5-89c0-5bbc-9c09-d6c83857abb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC34063',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 189140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-21',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2010}
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-30 11:43:58 [auto1.be] INFO: Saving data for CC34063: {'auction_closing_time': 1774885979.0, 'created_time': 1774773336.676398, 'last_price_update_time': 1774871038.271447}
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC34063') HTTP/1.1" 204 0
2026-03-30 11:43:58 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-30 11:43:58 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-30 11:43:58 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-30 11:43:58 [auto1.be] INFO: Scrape type for UX89863: 2
2026-03-30 11:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863
2026-03-30 11:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7578e7a-029a-51b8-b527-9e463ecb7214 with scrape type 2
2026-03-30 11:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7578e7a-029a-51b8-b527-9e463ecb7214 with scrape type 2
2026-03-30 11:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7578e7a-029a-51b8-b527-9e463ecb7214, identifier: UX89863
2026-03-30 11:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863
2026-03-30 11:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863
2026-03-30 11:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863 to the API
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:27Z',
 'fuel_type': 'diesel',
 'id': 'b7578e7a-029a-51b8-b527-9e463ecb7214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX89863',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 154425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-30 11:43:58 [auto1.be] INFO: Saving data for UX89863: {'auction_closing_time': 1774883307.0, 'created_time': 1774773338.405233, 'last_price_update_time': 1774871038.658637}
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX89863') HTTP/1.1" 204 0
2026-03-30 11:43:58 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-30 11:43:58 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-30 11:43:58 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-30 11:43:58 [auto1.be] INFO: Scrape type for AJ87899: 2
2026-03-30 11:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899
2026-03-30 11:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb51bc2-517f-524e-9c83-72007b99a8d9 with scrape type 2
2026-03-30 11:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cb51bc2-517f-524e-9c83-72007b99a8d9 with scrape type 2
2026-03-30 11:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cb51bc2-517f-524e-9c83-72007b99a8d9, identifier: AJ87899
2026-03-30 11:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899
2026-03-30 11:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899
2026-03-30 11:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899 to the API
2026-03-30 11:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': '3cb51bc2-517f-524e-9c83-72007b99a8d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ87899',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 126897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-16',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.be] INFO: Saving data for AJ87899: {'auction_closing_time': 1774884291.0, 'created_time': 1774773340.667777, 'last_price_update_time': 1774871039.167769}
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AJ87899') HTTP/1.1" 204 0
2026-03-30 11:43:59 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.be] INFO: Scrape type for RL01911: 2
2026-03-30 11:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911
2026-03-30 11:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942d178e-eac0-554e-a2a9-66af95a740a9 with scrape type 2
2026-03-30 11:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942d178e-eac0-554e-a2a9-66af95a740a9 with scrape type 2
2026-03-30 11:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 942d178e-eac0-554e-a2a9-66af95a740a9, identifier: RL01911
2026-03-30 11:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911
2026-03-30 11:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911
2026-03-30 11:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911 to the API
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-30T15:46:08Z',
 'fuel_type': 'petrol',
 'id': '942d178e-eac0-554e-a2a9-66af95a740a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL01911',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 159940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.be] INFO: Saving data for RL01911: {'auction_closing_time': 1774885568.0, 'created_time': 1773236052.776618, 'last_price_update_time': 1774871039.626438}
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL01911') HTTP/1.1" 204 0
2026-03-30 11:43:59 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-30 11:43:59 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-30 11:43:59 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.be] INFO: Scrape type for JV95971: 2
2026-03-30 11:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-30 11:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with scrape type 2
2026-03-30 11:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with scrape type 2
2026-03-30 11:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54, identifier: JV95971
2026-03-30 11:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-30 11:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-30 11:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971 to the API
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:11Z',
 'fuel_type': 'diesel',
 'id': '9007042e-c0f4-502a-ac2e-7bb33ba6ea54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV95971',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 180959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D Highgate',
 'transmission': 'manual',
 'trim': 'Highgate',
 'year': 2013}
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Saving data for JV95971: {'auction_closing_time': 1774884371.0, 'created_time': 1773779817.748891, 'last_price_update_time': 1774871040.049206}
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV95971') HTTP/1.1" 204 0
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Scrape type for SB67636: 2
2026-03-30 11:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-30 11:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with scrape type 2
2026-03-30 11:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with scrape type 2
2026-03-30 11:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb, identifier: SB67636
2026-03-30 11:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-30 11:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-30 11:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636 to the API
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:27:27Z',
 'fuel_type': 'diesel',
 'id': 'cbebe295-ccd7-5e45-a4df-92b27a8f0ccb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB67636',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 204706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2020}
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Saving data for SB67636: {'auction_closing_time': 1774884447.0, 'created_time': 1774352243.056934, 'last_price_update_time': 1774871040.444992}
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB67636') HTTP/1.1" 204 0
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Scrape type for CE14127: 0
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-30 11:44:00 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-30 11:44:00 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 11:44:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.684(s), this was the 1st time calling it.
2026-03-30 11:44:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.784877163510691 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:44:07 [scrapy.extensions.logstats] INFO: Crawled 203 pages (at 14 pages/min), scraped 192 items (at 75 items/min)
2026-03-30 11:44:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 11:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:00 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1763 | hits on page: 40
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for NH43704: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for XM15621: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for FM14350: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for FY63763: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for SZ16034: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for FP25504: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for BX88810: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for PD85961: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for XU03064: 2
2026-03-30 11:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-30 11:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14232f81-1b5a-5dd6-9aed-02252910cad7 with scrape type 2
2026-03-30 11:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14232f81-1b5a-5dd6-9aed-02252910cad7 with scrape type 2
2026-03-30 11:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14232f81-1b5a-5dd6-9aed-02252910cad7, identifier: XU03064
2026-03-30 11:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-30 11:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-30 11:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064 to the API
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:00:20Z',
 'fuel_type': 'diesel',
 'id': '14232f81-1b5a-5dd6-9aed-02252910cad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU03064',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 81592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Titanium',
 'transmission': 'automatic',
 'trim': '320 L2 Titanium',
 'year': 2023}
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Saving data for XU03064: {'auction_closing_time': 1774882820.0, 'created_time': 1774600279.863399, 'last_price_update_time': 1774871100.729412}
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU03064') HTTP/1.1" 204 0
2026-03-30 11:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for TX45109: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-30 11:45:00 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-30 11:45:00 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-30 11:45:07 [scrapy.extensions.logstats] INFO: Crawled 204 pages (at 1 pages/min), scraped 193 items (at 1 items/min)
2026-03-30 11:45:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 179MiB
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK57553> (referer: https://www.auto1.com/v1/car-details-view/PK57553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fa94e4-9dc7-5365-8fcf-e1141365852f with identifier: PK57553
2026-03-30 11:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fa94e4-9dc7-5365-8fcf-e1141365852f with scrape type 1
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_1513ad1e113e768505a30f67035e5735.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_1513ad1e113e768505a30f67035e5735.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_f91fa9fe90a614ddfa404607a7e2e1f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_f91fa9fe90a614ddfa404607a7e2e1f5.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_346a7bb16f8bdd7ffb6e5e3f51921f01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_346a7bb16f8bdd7ffb6e5e3f51921f01.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_a0e6ddc645872d863110c4e656fc6c80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a0e6ddc645872d863110c4e656fc6c80.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_e61ba7b9bedac37009847afdf90aac13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_e61ba7b9bedac37009847afdf90aac13.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_9cbf0c3ce80fec9422536ebfe1b234db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_9cbf0c3ce80fec9422536ebfe1b234db.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_5cc995df3f9f86eb399656006aea0db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_5cc995df3f9f86eb399656006aea0db6.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_a568863bd5d21076c78964605b888313.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a568863bd5d21076c78964605b888313.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_058e08c33f0fe5031f38a1a27f3ad4ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_058e08c33f0fe5031f38a1a27f3ad4ba.jpg not downloaded yet
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_cbf82f714173754392b343550bac166f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_cbf82f714173754392b343550bac166f.jpg not downloaded yet
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_1513ad1e113e768505a30f67035e5735.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9843310>
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_1513ad1e113e768505a30f67035e5735.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_1513ad1e113e768505a30f67035e5735.jpg saved to cache
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_9cbf0c3ce80fec9422536ebfe1b234db.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_e61ba7b9bedac37009847afdf90aac13.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_058e08c33f0fe5031f38a1a27f3ad4ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a0e6ddc645872d863110c4e656fc6c80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a568863bd5d21076c78964605b888313.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_f91fa9fe90a614ddfa404607a7e2e1f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_5cc995df3f9f86eb399656006aea0db6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_346a7bb16f8bdd7ffb6e5e3f51921f01.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_cbf82f714173754392b343550bac166f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:45:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9639e90>
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_9cbf0c3ce80fec9422536ebfe1b234db.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_9cbf0c3ce80fec9422536ebfe1b234db.jpg saved to cache
2026-03-30 11:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9841ad0>
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_e61ba7b9bedac37009847afdf90aac13.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_e61ba7b9bedac37009847afdf90aac13.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ec2eb6d0>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_058e08c33f0fe5031f38a1a27f3ad4ba.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_058e08c33f0fe5031f38a1a27f3ad4ba.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea116b90>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_a0e6ddc645872d863110c4e656fc6c80.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a0e6ddc645872d863110c4e656fc6c80.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7ea2060d0>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_a568863bd5d21076c78964605b888313.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a568863bd5d21076c78964605b888313.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e97e7b90>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_f91fa9fe90a614ddfa404607a7e2e1f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_f91fa9fe90a614ddfa404607a7e2e1f5.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9887b90>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_5cc995df3f9f86eb399656006aea0db6.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_5cc995df3f9f86eb399656006aea0db6.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7e9841150>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_346a7bb16f8bdd7ffb6e5e3f51921f01.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_346a7bb16f8bdd7ffb6e5e3f51921f01.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe7eaeb8dd0>
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:45:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F76%252F897603ce9dd1a458fcfa3f260b043d9b%252Fpa%252FPK57553_cbf82f714173754392b343550bac166f.jpg') HTTP/1.1" 204 0
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_cbf82f714173754392b343550bac166f.jpg saved to cache
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80fa94e4-9dc7-5365-8fcf-e1141365852f
2026-03-30 11:45:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80fa94e4-9dc7-5365-8fcf-e1141365852f, skipping ID generation
2026-03-30 11:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fa94e4-9dc7-5365-8fcf-e1141365852f with scrape type 1
2026-03-30 11:45:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80fa94e4-9dc7-5365-8fcf-e1141365852f sending to next pipeline
2026-03-30 11:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80fa94e4-9dc7-5365-8fcf-e1141365852f, identifier: PK57553
2026-03-30 11:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80fa94e4-9dc7-5365-8fcf-e1141365852f with identifier: PK57553
2026-03-30 11:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80fa94e4-9dc7-5365-8fcf-e1141365852f with identifier: PK57553
2026-03-30 11:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80fa94e4-9dc7-5365-8fcf-e1141365852f with identifier: PK57553 to the API
2026-03-30 11:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_cbf82f714173754392b343550bac166f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:41:13Z',
 'fuel_type': 'petrol',
 'id': '80fa94e4-9dc7-5365-8fcf-e1141365852f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK57553',
 'listing': 'auction',
 'location': 'BE, Tradein',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 167018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_1513ad1e113e768505a30f67035e5735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491226,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_f91fa9fe90a614ddfa404607a7e2e1f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_346a7bb16f8bdd7ffb6e5e3f51921f01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a0e6ddc645872d863110c4e656fc6c80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_e61ba7b9bedac37009847afdf90aac13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_9cbf0c3ce80fec9422536ebfe1b234db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_5cc995df3f9f86eb399656006aea0db6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2338903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_a568863bd5d21076c78964605b888313.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_058e08c33f0fe5031f38a1a27f3ad4ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80fa94e4-9dc7-5365-8fcf-e1141365852f/80fa94e4-9dc7-5365-8fcf-e1141365852f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2553866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/76/897603ce9dd1a458fcfa3f260b043d9b/pa/PK57553_cbf82f714173754392b343550bac166f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.4 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2004}
2026-03-30 11:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK57553%27 HTTP/1.1" 200 None
2026-03-30 11:45:21 [auto1.be] INFO: Saving data for PK57553: {'created_time': 1774871121.515451, 'last_price_update_time': 1774871121.515463, 'auction_closing_time': 1774971673.0}
2026-03-30 11:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK57553') HTTP/1.1" 204 0
2026-03-30 11:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:45:22 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1764 | hits on page: 40
2026-03-30 11:45:22 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-30 11:45:22 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-30 11:45:22 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-30 11:45:22 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-30 11:45:22 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-30 11:45:22 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-30 11:45:22 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-30 11:45:22 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-30 11:45:22 [auto1.be] INFO: Scrape type for DW61635: 2
2026-03-30 11:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-30 11:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e51fe1-0876-577a-8329-d692268c9773 with scrape type 2
2026-03-30 11:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e51fe1-0876-577a-8329-d692268c9773 with scrape type 2
2026-03-30 11:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93e51fe1-0876-577a-8329-d692268c9773, identifier: DW61635
2026-03-30 11:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-30 11:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-30 11:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635 to the API
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:29Z',
 'fuel_type': 'petrol',
 'id': '93e51fe1-0876-577a-8329-d692268c9773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW61635',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 104639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-16',
 'seller_name': None,
 'title': 'Renault Megane 1.4 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2002}
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Saving data for DW61635: {'auction_closing_time': 1774885409.0, 'created_time': 1774557219.813369, 'last_price_update_time': 1774871123.059132}
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW61635') HTTP/1.1" 204 0
2026-03-30 11:45:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for XZ54371: 2
2026-03-30 11:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-30 11:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1603053a-812f-5d8f-a76f-4826030020e5 with scrape type 2
2026-03-30 11:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1603053a-812f-5d8f-a76f-4826030020e5 with scrape type 2
2026-03-30 11:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1603053a-812f-5d8f-a76f-4826030020e5, identifier: XZ54371
2026-03-30 11:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-30 11:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-30 11:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371 to the API
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:59Z',
 'fuel_type': 'petrol',
 'id': '1603053a-812f-5d8f-a76f-4826030020e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ54371',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 67531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-11',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Saving data for XZ54371: {'auction_closing_time': 1774885799.0, 'created_time': 1773301759.722365, 'last_price_update_time': 1774871123.573325}
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ54371') HTTP/1.1" 204 0
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-30 11:45:23 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-30 11:45:23 [auto1.be] INFO: Scrape type for ML85388: 2
2026-03-30 11:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-30 11:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42769972-c432-5d32-aaf0-c251c5dd4e3c with scrape type 2
2026-03-30 11:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42769972-c432-5d32-aaf0-c251c5dd4e3c with scrape type 2
2026-03-30 11:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42769972-c432-5d32-aaf0-c251c5dd4e3c, identifier: ML85388
2026-03-30 11:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-30 11:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-30 11:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388 to the API
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:37Z',
 'fuel_type': 'hybrid',
 'id': '42769972-c432-5d32-aaf0-c251c5dd4e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML85388',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 213734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.be] INFO: Saving data for ML85388: {'auction_closing_time': 1774882957.0, 'created_time': 1774557179.473528, 'last_price_update_time': 1774871124.080347}
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML85388') HTTP/1.1" 204 0
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.be] INFO: Scrape type for AJ68637: 2
2026-03-30 11:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-30 11:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with scrape type 2
2026-03-30 11:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with scrape type 2
2026-03-30 11:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01, identifier: AJ68637
2026-03-30 11:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-30 11:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-30 11:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637 to the API
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:07Z',
 'fuel_type': 'diesel',
 'id': 'ee21d84f-d6ac-5fbd-b303-1b42f25e0b01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ68637',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 282721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.be] INFO: Saving data for AJ68637: {'auction_closing_time': 1774883347.0, 'created_time': 1774557210.944023, 'last_price_update_time': 1774871124.612066}
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AJ68637') HTTP/1.1" 204 0
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-30 11:45:24 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-30 11:45:24 [auto1.be] INFO: Scrape type for SE23508: 2
2026-03-30 11:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-30 11:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c69bc39-c11c-5919-8d30-91351a0d8613 with scrape type 2
2026-03-30 11:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c69bc39-c11c-5919-8d30-91351a0d8613 with scrape type 2
2026-03-30 11:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c69bc39-c11c-5919-8d30-91351a0d8613, identifier: SE23508
2026-03-30 11:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-30 11:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-30 11:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508 to the API
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:02Z',
 'fuel_type': 'petrol',
 'id': '4c69bc39-c11c-5919-8d30-91351a0d8613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE23508',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.be] INFO: Saving data for SE23508: {'auction_closing_time': 1774882922.0, 'created_time': 1774557228.459315, 'last_price_update_time': 1774871125.08993}
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE23508') HTTP/1.1" 204 0
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.be] INFO: Scrape type for WW99205: 2
2026-03-30 11:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-30 11:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952fc525-855c-5468-94f2-9f1dc66a8654 with scrape type 2
2026-03-30 11:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 952fc525-855c-5468-94f2-9f1dc66a8654 with scrape type 2
2026-03-30 11:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 952fc525-855c-5468-94f2-9f1dc66a8654, identifier: WW99205
2026-03-30 11:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 11:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-30 11:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205 to the API
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:26Z',
 'fuel_type': 'diesel',
 'id': '952fc525-855c-5468-94f2-9f1dc66a8654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW99205',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 157448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-19',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2009}
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.be] INFO: Saving data for WW99205: {'auction_closing_time': 1774885346.0, 'created_time': 1774600266.092938, 'last_price_update_time': 1774871125.753517}
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW99205') HTTP/1.1" 204 0
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-30 11:45:25 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-30 11:45:25 [auto1.be] INFO: Scrape type for WA10715: 2
2026-03-30 11:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-30 11:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b06023d-030b-506e-9366-3f2bfff4ecb6 with scrape type 2
2026-03-30 11:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b06023d-030b-506e-9366-3f2bfff4ecb6 with scrape type 2
2026-03-30 11:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b06023d-030b-506e-9366-3f2bfff4ecb6, identifier: WA10715
2026-03-30 11:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-30 11:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-30 11:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715 to the API
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:13Z',
 'fuel_type': 'petrol',
 'id': '6b06023d-030b-506e-9366-3f2bfff4ecb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA10715',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 80846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-30 11:45:26 [auto1.be] INFO: Saving data for WA10715: {'auction_closing_time': 1774885693.0, 'created_time': 1774557103.761216, 'last_price_update_time': 1774871126.203749}
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA10715') HTTP/1.1" 204 0
2026-03-30 11:45:26 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-30 11:45:26 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-30 11:45:26 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-30 11:45:26 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-30 11:45:26 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-30 11:45:26 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-30 11:45:26 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-30 11:45:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.974(s), this was the 1st time calling it.
2026-03-30 11:45:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.327329290010724 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:46:07 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 2 pages/min), scraped 201 items (at 8 items/min)
2026-03-30 11:46:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:34 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1764 | hits on page: 40
2026-03-30 11:46:34 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-30 11:46:34 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-30 11:46:34 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-30 11:46:34 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-30 11:46:34 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-30 11:46:34 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-30 11:46:34 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-30 11:46:34 [auto1.be] INFO: Scrape type for DL13581: 2
2026-03-30 11:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-30 11:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with scrape type 2
2026-03-30 11:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with scrape type 2
2026-03-30 11:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3c3753a-ae47-58f1-923e-7d8092dd3ad8, identifier: DL13581
2026-03-30 11:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-30 11:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-30 11:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581 to the API
2026-03-30 11:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:01Z',
 'fuel_type': 'diesel',
 'id': 'f3c3753a-ae47-58f1-923e-7d8092dd3ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13581',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 89805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Opel Movano 2.3 Biturbo CDTI HKa L2H2 3,5t',
 'transmission': 'manual',
 'trim': 'HKa L2H2 3,5t',
 'year': 2015}
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Saving data for DL13581: {'auction_closing_time': 1774885201.0, 'created_time': 1773137136.836779, 'last_price_update_time': 1774871195.112917}
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL13581') HTTP/1.1" 204 0
2026-03-30 11:46:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for HP15544: 2
2026-03-30 11:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-30 11:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with scrape type 2
2026-03-30 11:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with scrape type 2
2026-03-30 11:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56e4ca33-c073-51a0-b1d9-e895a5b9af41, identifier: HP15544
2026-03-30 11:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-30 11:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-30 11:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544 to the API
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:02:54Z',
 'fuel_type': 'diesel',
 'id': '56e4ca33-c073-51a0-b1d9-e895a5b9af41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP15544',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 116128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-09',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM B-Tech',
 'transmission': 'automatic',
 'trim': 'B-Tech',
 'year': 2020}
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Saving data for HP15544: {'auction_closing_time': 1774882974.0, 'created_time': 1774557097.753026, 'last_price_update_time': 1774871195.589777}
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP15544') HTTP/1.1" 204 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for FB34577: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-30 11:46:35 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-30 11:46:35 [auto1.be] INFO: Scrape type for WK92284: 2
2026-03-30 11:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-30 11:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3947d5f0-185f-5649-9c9d-932e1a474b66 with scrape type 2
2026-03-30 11:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3947d5f0-185f-5649-9c9d-932e1a474b66 with scrape type 2
2026-03-30 11:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3947d5f0-185f-5649-9c9d-932e1a474b66, identifier: WK92284
2026-03-30 11:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-30 11:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-30 11:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284 to the API
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:59:22Z',
 'fuel_type': 'diesel',
 'id': '3947d5f0-185f-5649-9c9d-932e1a474b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK92284',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Saving data for WK92284: {'auction_closing_time': 1774886362.0, 'created_time': 1774557104.921767, 'last_price_update_time': 1774871196.300958}
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK92284') HTTP/1.1" 204 0
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Scrape type for TH53375: 2
2026-03-30 11:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-30 11:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with scrape type 2
2026-03-30 11:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with scrape type 2
2026-03-30 11:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 308b899d-5b1e-5d13-82a6-60fff2b4edd5, identifier: TH53375
2026-03-30 11:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-30 11:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-30 11:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375 to the API
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'diesel',
 'id': '308b899d-5b1e-5d13-82a6-60fff2b4edd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH53375',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 177464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI lang Select',
 'transmission': 'automatic',
 'trim': 'lang Select',
 'year': 2017}
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Saving data for TH53375: {'auction_closing_time': 1774883713.0, 'created_time': 1774557152.940883, 'last_price_update_time': 1774871196.898832}
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH53375') HTTP/1.1" 204 0
2026-03-30 11:46:36 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-30 11:46:36 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-30 11:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP64543> (referer: https://www.auto1.com/v1/car-details-view/XP64543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef795196-ec1e-5f8c-9996-04e58323a543 with identifier: XP64543
2026-03-30 11:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef795196-ec1e-5f8c-9996-04e58323a543 with scrape type 1
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef795196-ec1e-5f8c-9996-04e58323a543
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_286f9ef04638faa62f088a7bca76cc69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_286f9ef04638faa62f088a7bca76cc69.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_d1a6e691bea359bf403d83c31a120c0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_d1a6e691bea359bf403d83c31a120c0f.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_890d9220e80dc569fd630f87f898ce13.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_890d9220e80dc569fd630f87f898ce13.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_a6e5ba4ed1e5c53517432fc9f587eb1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_a6e5ba4ed1e5c53517432fc9f587eb1a.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_7c520262248162341ed82f79272e8b8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_7c520262248162341ed82f79272e8b8f.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_386228f4f1f94132e3de8eece1d38f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_386228f4f1f94132e3de8eece1d38f61.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_a2f1c78bedffd48ae4d7ac03b5e3cfb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_a2f1c78bedffd48ae4d7ac03b5e3cfb6.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_1100107670f77b1a3573497a5b773157.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1100107670f77b1a3573497a5b773157.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_1885008df3ca9c3c98f43454d5ab16dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1885008df3ca9c3c98f43454d5ab16dc.jpg already downloaded
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fc9%252Fc7c95293e3b63be512eed5fcf3c0a25f%252Fpa%252FXP64543_1200f2d2b2540621ec4855c43ff275a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1200f2d2b2540621ec4855c43ff275a1.jpg already downloaded
2026-03-30 11:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef795196-ec1e-5f8c-9996-04e58323a543, identifier: XP64543
2026-03-30 11:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef795196-ec1e-5f8c-9996-04e58323a543 with identifier: XP64543
2026-03-30 11:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef795196-ec1e-5f8c-9996-04e58323a543 with identifier: XP64543
2026-03-30 11:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef795196-ec1e-5f8c-9996-04e58323a543 with identifier: XP64543 to the API
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XP64543>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-31T15:57:30Z',
 'fuel_type': 'petrol',
 'id': 'ef795196-ec1e-5f8c-9996-04e58323a543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP64543',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 125137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_286f9ef04638faa62f088a7bca76cc69.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_d1a6e691bea359bf403d83c31a120c0f.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_890d9220e80dc569fd630f87f898ce13.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_a6e5ba4ed1e5c53517432fc9f587eb1a.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_7c520262248162341ed82f79272e8b8f.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_386228f4f1f94132e3de8eece1d38f61.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_a2f1c78bedffd48ae4d7ac03b5e3cfb6.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1100107670f77b1a3573497a5b773157.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1885008df3ca9c3c98f43454d5ab16dc.jpg',
                'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1200f2d2b2540621ec4855c43ff275a1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_286f9ef04638faa62f088a7bca76cc69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400233,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_d1a6e691bea359bf403d83c31a120c0f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367340,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_890d9220e80dc569fd630f87f898ce13.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_a6e5ba4ed1e5c53517432fc9f587eb1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_7c520262248162341ed82f79272e8b8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_386228f4f1f94132e3de8eece1d38f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287225,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_a2f1c78bedffd48ae4d7ac03b5e3cfb6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1100107670f77b1a3573497a5b773157.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389013,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1885008df3ca9c3c98f43454d5ab16dc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef795196-ec1e-5f8c-9996-04e58323a543/ef795196-ec1e-5f8c-9996-04e58323a543_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/c9/c7c95293e3b63be512eed5fcf3c0a25f/pa/XP64543_1200f2d2b2540621ec4855c43ff275a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2018}
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP64543%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.be] INFO: Saving data for XP64543: {'created_time': 1774871198.800558, 'last_price_update_time': 1774871198.800575, 'auction_closing_time': 1774972650.0}
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XP64543') HTTP/1.1" 204 0
2026-03-30 11:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:46:38 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1764 | hits on page: 40
2026-03-30 11:46:38 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-30 11:46:38 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-30 11:46:38 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-30 11:46:38 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-30 11:46:38 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-30 11:46:38 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Scrape type for DF44974: 2
2026-03-30 11:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-30 11:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3918341-d117-5a76-a190-c0d113d723e8 with scrape type 2
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3918341-d117-5a76-a190-c0d113d723e8 with scrape type 2
2026-03-30 11:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3918341-d117-5a76-a190-c0d113d723e8, identifier: DF44974
2026-03-30 11:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-30 11:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-30 11:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974 to the API
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:15Z',
 'fuel_type': 'diesel',
 'id': 'c3918341-d117-5a76-a190-c0d113d723e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF44974',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 128495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Saving data for DF44974: {'auction_closing_time': 1774884075.0, 'created_time': 1774557241.034083, 'last_price_update_time': 1774871199.412011}
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF44974') HTTP/1.1" 204 0
2026-03-30 11:46:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Scrape type for ZM46816: 2
2026-03-30 11:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-30 11:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893033fc-503b-505f-b9ed-049119557949 with scrape type 2
2026-03-30 11:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893033fc-503b-505f-b9ed-049119557949 with scrape type 2
2026-03-30 11:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 893033fc-503b-505f-b9ed-049119557949, identifier: ZM46816
2026-03-30 11:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-30 11:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-30 11:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816 to the API
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'diesel',
 'id': '893033fc-503b-505f-b9ed-049119557949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM46816',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 156922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Sport edition',
 'transmission': 'manual',
 'trim': 'Sport edition',
 'year': 2017}
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-30 11:46:39 [auto1.be] INFO: Saving data for ZM46816: {'auction_closing_time': 1774886340.0, 'created_time': 1774557228.782041, 'last_price_update_time': 1774871199.969908}
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM46816') HTTP/1.1" 204 0
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-30 11:46:39 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-30 11:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for PE83293: 2
2026-03-30 11:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-30 11:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a7db30-7d11-5a08-b83c-36646e27f7c9 with scrape type 2
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a7db30-7d11-5a08-b83c-36646e27f7c9 with scrape type 2
2026-03-30 11:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4a7db30-7d11-5a08-b83c-36646e27f7c9, identifier: PE83293
2026-03-30 11:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-30 11:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-30 11:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293 to the API
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:47Z',
 'fuel_type': 'petrol',
 'id': 'b4a7db30-7d11-5a08-b83c-36646e27f7c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE83293',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 57690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Saving data for PE83293: {'auction_closing_time': 1774885787.0, 'created_time': 1774557191.550311, 'last_price_update_time': 1774871200.54595}
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE83293') HTTP/1.1" 204 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-30 11:46:40 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-30 11:46:40 [auto1.be] INFO: Scrape type for YG22909: 2
2026-03-30 11:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-30 11:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade3345c-0246-5af7-9e45-7c293e54e453 with scrape type 2
2026-03-30 11:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade3345c-0246-5af7-9e45-7c293e54e453 with scrape type 2
2026-03-30 11:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ade3345c-0246-5af7-9e45-7c293e54e453, identifier: YG22909
2026-03-30 11:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-30 11:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-30 11:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909 to the API
2026-03-30 11:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:33Z',
 'fuel_type': 'diesel',
 'id': 'ade3345c-0246-5af7-9e45-7c293e54e453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG22909',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 118099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2019}
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-30 11:46:41 [auto1.be] INFO: Saving data for YG22909: {'auction_closing_time': 1774884453.0, 'created_time': 1774557211.689161, 'last_price_update_time': 1774871201.168793}
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG22909') HTTP/1.1" 204 0
2026-03-30 11:46:41 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-30 11:46:41 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-30 11:46:41 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-30 11:46:41 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-30 11:46:41 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-30 11:46:41 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 11:47:07 [scrapy.extensions.logstats] INFO: Crawled 209 pages (at 3 pages/min), scraped 210 items (at 9 items/min)
2026-03-30 11:47:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:49 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1765 | hits on page: 40
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-30 11:47:49 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-30 11:47:49 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-30 11:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:51 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1765 | hits on page: 40
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Scrape type for XK61886: 2
2026-03-30 11:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-30 11:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18dafbc4-2a81-5a8c-9d11-0f297476e6af with scrape type 2
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18dafbc4-2a81-5a8c-9d11-0f297476e6af with scrape type 2
2026-03-30 11:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18dafbc4-2a81-5a8c-9d11-0f297476e6af, identifier: XK61886
2026-03-30 11:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-30 11:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-30 11:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886 to the API
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:28:01Z',
 'fuel_type': 'petrol',
 'id': '18dafbc4-2a81-5a8c-9d11-0f297476e6af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK61886',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 98987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-13',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 150',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Saving data for XK61886: {'auction_closing_time': 1774884481.0, 'created_time': 1773952979.905587, 'last_price_update_time': 1774871271.56543}
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK61886') HTTP/1.1" 204 0
2026-03-30 11:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-30 11:47:51 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-30 11:47:51 [auto1.be] INFO: Scrape type for SD60477: 2
2026-03-30 11:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-30 11:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c308f-15ef-532a-9282-4ec5834d659a with scrape type 2
2026-03-30 11:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c28c308f-15ef-532a-9282-4ec5834d659a with scrape type 2
2026-03-30 11:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c28c308f-15ef-532a-9282-4ec5834d659a, identifier: SD60477
2026-03-30 11:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-30 11:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-30 11:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477 to the API
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:39:47Z',
 'fuel_type': 'petrol',
 'id': 'c28c308f-15ef-532a-9282-4ec5834d659a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD60477',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 194585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 Si4 TwinTurbo HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2021}
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Saving data for SD60477: {'auction_closing_time': 1774885187.0, 'created_time': 1774557246.682763, 'last_price_update_time': 1774871272.064758}
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD60477') HTTP/1.1" 204 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-30 11:47:52 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-30 11:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:53 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1765 | hits on page: 40
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Scrape type for AU32211: 2
2026-03-30 11:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-30 11:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a04fdbc6-010c-5083-9052-2c13ea0e120f with scrape type 2
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a04fdbc6-010c-5083-9052-2c13ea0e120f with scrape type 2
2026-03-30 11:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a04fdbc6-010c-5083-9052-2c13ea0e120f, identifier: AU32211
2026-03-30 11:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-30 11:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-30 11:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211 to the API
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:47:45Z',
 'fuel_type': 'diesel',
 'id': 'a04fdbc6-010c-5083-9052-2c13ea0e120f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU32211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 87774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2020}
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Saving data for AU32211: {'auction_closing_time': 1774885665.0, 'created_time': 1774600290.140546, 'last_price_update_time': 1774871273.570468}
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU32211') HTTP/1.1" 204 0
2026-03-30 11:47:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-30 11:47:53 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-30 11:47:53 [auto1.be] INFO: Scrape type for TF03002: 2
2026-03-30 11:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-30 11:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045185d6-ec84-53e2-bef2-8b5b975effb3 with scrape type 2
2026-03-30 11:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045185d6-ec84-53e2-bef2-8b5b975effb3 with scrape type 2
2026-03-30 11:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 045185d6-ec84-53e2-bef2-8b5b975effb3, identifier: TF03002
2026-03-30 11:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-30 11:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-30 11:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002 to the API
2026-03-30 11:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:06:53Z',
 'fuel_type': 'petrol',
 'id': '045185d6-ec84-53e2-bef2-8b5b975effb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF03002',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 199816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Saving data for TF03002: {'auction_closing_time': 1774883213.0, 'created_time': 1774600275.066094, 'last_price_update_time': 1774871274.14063}
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF03002') HTTP/1.1" 204 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for KK24955: 2
2026-03-30 11:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-30 11:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with scrape type 2
2026-03-30 11:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with scrape type 2
2026-03-30 11:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64, identifier: KK24955
2026-03-30 11:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-30 11:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-30 11:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955 to the API
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:33:33Z',
 'fuel_type': 'petrol',
 'id': '8559ff82-4084-5bd2-bddd-f93c8ed5cb64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK24955',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 166708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-17',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Saving data for KK24955: {'auction_closing_time': 1774884813.0, 'created_time': 1774557117.188305, 'last_price_update_time': 1774871274.548283}
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KK24955') HTTP/1.1" 204 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-30 11:47:54 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-30 11:47:54 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-30 11:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:55 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1765 | hits on page: 40
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-30 11:47:55 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-30 11:47:55 [auto1.be] INFO: Scrape type for EW63431: 2
2026-03-30 11:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-30 11:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with scrape type 2
2026-03-30 11:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with scrape type 2
2026-03-30 11:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8766d71c-f005-5ad6-a607-4b5d5ed7d704, identifier: EW63431
2026-03-30 11:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-30 11:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-30 11:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431 to the API
2026-03-30 11:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:26:40Z',
 'fuel_type': 'diesel',
 'id': '8766d71c-f005-5ad6-a607-4b5d5ed7d704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW63431',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 177017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-22',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Saving data for EW63431: {'auction_closing_time': 1774884400.0, 'created_time': 1773693466.514536, 'last_price_update_time': 1774871276.169224}
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EW63431') HTTP/1.1" 204 0
2026-03-30 11:47:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for DS23322: 2
2026-03-30 11:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-30 11:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32595404-1235-5729-b80a-df37f9f8a1ab with scrape type 2
2026-03-30 11:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32595404-1235-5729-b80a-df37f9f8a1ab with scrape type 2
2026-03-30 11:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 32595404-1235-5729-b80a-df37f9f8a1ab, identifier: DS23322
2026-03-30 11:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-30 11:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-30 11:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322 to the API
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'diesel',
 'id': '32595404-1235-5729-b80a-df37f9f8a1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS23322',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 99310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Saving data for DS23322: {'auction_closing_time': 1774886222.0, 'created_time': 1774557227.081863, 'last_price_update_time': 1774871276.668098}
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DS23322') HTTP/1.1" 204 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 11:47:56 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-30 11:48:07 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 4 pages/min), scraped 217 items (at 7 items/min)
2026-03-30 11:48:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:49:07 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 0 pages/min), scraped 217 items (at 0 items/min)
2026-03-30 11:49:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:50:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.791(s), this was the 1st time calling it.
2026-03-30 11:50:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.101043135884634 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:50:07 [scrapy.extensions.logstats] INFO: Crawled 213 pages (at 0 pages/min), scraped 217 items (at 0 items/min)
2026-03-30 11:50:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:50:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:31 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:31 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 11:50:31 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-30 11:50:31 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-30 11:50:31 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-30 11:50:31 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-30 11:50:31 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-30 11:50:31 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-30 11:50:31 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-30 11:50:31 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-30 11:50:31 [auto1.be] INFO: Scrape type for BC49055: 2
2026-03-30 11:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-30 11:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b88e7b-80c5-5158-8670-f261c41b45fc with scrape type 2
2026-03-30 11:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b88e7b-80c5-5158-8670-f261c41b45fc with scrape type 2
2026-03-30 11:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9b88e7b-80c5-5158-8670-f261c41b45fc, identifier: BC49055
2026-03-30 11:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-30 11:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-30 11:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055 to the API
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:55Z',
 'fuel_type': 'petrol',
 'id': 'c9b88e7b-80c5-5158-8670-f261c41b45fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC49055',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 144720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-10',
 'seller_name': None,
 'title': 'Opel Tigra 1.4 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2005}
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Saving data for BC49055: {'auction_closing_time': 1774886035.0, 'created_time': 1774600271.352348, 'last_price_update_time': 1774871432.240473}
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC49055') HTTP/1.1" 204 0
2026-03-30 11:50:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-30 11:50:32 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Scrape type for RA11008: 2
2026-03-30 11:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-30 11:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with scrape type 2
2026-03-30 11:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with scrape type 2
2026-03-30 11:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4419f0c6-fafe-5a86-8bda-b9d9221dc288, identifier: RA11008
2026-03-30 11:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-30 11:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-30 11:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008 to the API
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:28Z',
 'fuel_type': 'diesel',
 'id': '4419f0c6-fafe-5a86-8bda-b9d9221dc288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA11008',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 191118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-14',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2013}
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-30 11:50:32 [auto1.be] INFO: Saving data for RA11008: {'auction_closing_time': 1774886308.0, 'created_time': 1773779707.95762, 'last_price_update_time': 1774871432.905194}
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA11008') HTTP/1.1" 204 0
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-30 11:50:33 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-30 11:50:33 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-30 11:50:33 [auto1.be] INFO: Scrape type for XL26167: 0
2026-03-30 11:50:33 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-30 11:50:33 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-30 11:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:36 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for UX15937: 2
2026-03-30 11:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-30 11:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1450a068-55de-5e8d-814a-11cfb726c7d8 with scrape type 2
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1450a068-55de-5e8d-814a-11cfb726c7d8 with scrape type 2
2026-03-30 11:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1450a068-55de-5e8d-814a-11cfb726c7d8, identifier: UX15937
2026-03-30 11:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-30 11:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-30 11:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937 to the API
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'petrol',
 'id': '1450a068-55de-5e8d-814a-11cfb726c7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX15937',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 165373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-02',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Saving data for UX15937: {'auction_closing_time': 1774885332.0, 'created_time': 1773237862.379495, 'last_price_update_time': 1774871436.671467}
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX15937') HTTP/1.1" 204 0
2026-03-30 11:50:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-30 11:50:36 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-30 11:50:36 [auto1.be] INFO: Scrape type for FA61625: 2
2026-03-30 11:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-30 11:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca60800a-cbc0-5456-8454-e5f8f0299db8 with scrape type 2
2026-03-30 11:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca60800a-cbc0-5456-8454-e5f8f0299db8 with scrape type 2
2026-03-30 11:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca60800a-cbc0-5456-8454-e5f8f0299db8, identifier: FA61625
2026-03-30 11:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-30 11:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-30 11:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625 to the API
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:44Z',
 'fuel_type': 'petrol',
 'id': 'ca60800a-cbc0-5456-8454-e5f8f0299db8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA61625',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 87303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-01',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2023}
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Saving data for FA61625: {'auction_closing_time': 1774883744.0, 'created_time': 1773909054.800169, 'last_price_update_time': 1774871437.22505}
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA61625') HTTP/1.1" 204 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for SX30605: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-30 11:50:37 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-30 11:50:37 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-30 11:50:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:39 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-30 11:50:39 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-30 11:50:39 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-30 11:50:39 [auto1.be] INFO: Scrape type for MN41841: 2
2026-03-30 11:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-30 11:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f978f149-e638-548e-8826-f7636922c944 with scrape type 2
2026-03-30 11:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f978f149-e638-548e-8826-f7636922c944 with scrape type 2
2026-03-30 11:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f978f149-e638-548e-8826-f7636922c944, identifier: MN41841
2026-03-30 11:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-30 11:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-30 11:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841 to the API
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:40:54Z',
 'fuel_type': 'petrol',
 'id': 'f978f149-e638-548e-8826-f7636922c944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN41841',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 51950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-24',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2020}
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-30 11:50:39 [auto1.be] INFO: Saving data for MN41841: {'auction_closing_time': 1774885254.0, 'created_time': 1774557197.321646, 'last_price_update_time': 1774871439.736434}
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MN41841') HTTP/1.1" 204 0
2026-03-30 11:50:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-30 11:50:39 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-30 11:50:39 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-30 11:50:39 [auto1.be] INFO: Scrape type for UA82763: 2
2026-03-30 11:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-30 11:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311bae9a-b079-581b-b8c8-5dd42c88efda with scrape type 2
2026-03-30 11:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 311bae9a-b079-581b-b8c8-5dd42c88efda with scrape type 2
2026-03-30 11:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 311bae9a-b079-581b-b8c8-5dd42c88efda, identifier: UA82763
2026-03-30 11:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-30 11:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-30 11:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763 to the API
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:18Z',
 'fuel_type': 'petrol',
 'id': '311bae9a-b079-581b-b8c8-5dd42c88efda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA82763',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 105664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Saving data for UA82763: {'auction_closing_time': 1774884858.0, 'created_time': 1774557082.88172, 'last_price_update_time': 1774871440.294041}
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA82763') HTTP/1.1" 204 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for RW15578: 2
2026-03-30 11:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-30 11:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73abd779-7569-5cae-994d-decd1e37cc99 with scrape type 2
2026-03-30 11:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73abd779-7569-5cae-994d-decd1e37cc99 with scrape type 2
2026-03-30 11:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73abd779-7569-5cae-994d-decd1e37cc99, identifier: RW15578
2026-03-30 11:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-30 11:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-30 11:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578 to the API
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:45Z',
 'fuel_type': 'petrol',
 'id': '73abd779-7569-5cae-994d-decd1e37cc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW15578',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 100923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Opel Combo 1.4 Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2011}
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Saving data for RW15578: {'auction_closing_time': 1774885365.0, 'created_time': 1774557230.269752, 'last_price_update_time': 1774871440.692944}
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW15578') HTTP/1.1" 204 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for MJ77172: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-30 11:50:40 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-30 11:50:40 [auto1.be] INFO: Scrape type for ZP07177: 2
2026-03-30 11:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-30 11:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69765ded-891c-5b27-a92d-03388c67e8a7 with scrape type 2
2026-03-30 11:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69765ded-891c-5b27-a92d-03388c67e8a7 with scrape type 2
2026-03-30 11:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69765ded-891c-5b27-a92d-03388c67e8a7, identifier: ZP07177
2026-03-30 11:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-30 11:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-30 11:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177 to the API
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:39:59Z',
 'fuel_type': 'petrol',
 'id': '69765ded-891c-5b27-a92d-03388c67e8a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP07177',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 123075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Saving data for ZP07177: {'auction_closing_time': 1774885199.0, 'created_time': 1774557181.691529, 'last_price_update_time': 1774871441.302359}
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP07177') HTTP/1.1" 204 0
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-30 11:50:41 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-30 11:50:41 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-30 11:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:47 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Scrape type for FP68376: 2
2026-03-30 11:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-30 11:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with scrape type 2
2026-03-30 11:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with scrape type 2
2026-03-30 11:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf, identifier: FP68376
2026-03-30 11:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-30 11:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-30 11:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376 to the API
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'petrol',
 'id': '35d200c7-af14-5a63-a9e3-ba5a9a838fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP68376',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 117701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-12',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2015}
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Saving data for FP68376: {'auction_closing_time': 1774884826.0, 'created_time': 1774557189.746164, 'last_price_update_time': 1774871447.872646}
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP68376') HTTP/1.1" 204 0
2026-03-30 11:50:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-30 11:50:47 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-30 11:50:47 [auto1.be] INFO: Scrape type for JZ88652: 2
2026-03-30 11:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-30 11:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b991e6f-1d23-5887-a345-1c2d47850084 with scrape type 2
2026-03-30 11:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b991e6f-1d23-5887-a345-1c2d47850084 with scrape type 2
2026-03-30 11:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b991e6f-1d23-5887-a345-1c2d47850084, identifier: JZ88652
2026-03-30 11:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-30 11:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-30 11:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652 to the API
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:38:16Z',
 'fuel_type': 'diesel',
 'id': '3b991e6f-1d23-5887-a345-1c2d47850084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ88652',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 162300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-13',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2020}
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Saving data for JZ88652: {'auction_closing_time': 1774885096.0, 'created_time': 1773909034.86822, 'last_price_update_time': 1774871448.349862}
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ88652') HTTP/1.1" 204 0
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-30 11:50:48 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Scrape type for GR78986: 2
2026-03-30 11:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-30 11:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78187941-5f25-5bbe-9615-e404d832696b with scrape type 2
2026-03-30 11:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78187941-5f25-5bbe-9615-e404d832696b with scrape type 2
2026-03-30 11:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78187941-5f25-5bbe-9615-e404d832696b, identifier: GR78986
2026-03-30 11:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-30 11:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-30 11:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986 to the API
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:10:32Z',
 'fuel_type': 'hybrid',
 'id': '78187941-5f25-5bbe-9615-e404d832696b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR78986',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 81537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-30 11:50:48 [auto1.be] INFO: Saving data for GR78986: {'auction_closing_time': 1774883432.0, 'created_time': 1774557247.275806, 'last_price_update_time': 1774871448.924531}
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR78986') HTTP/1.1" 204 0
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-30 11:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-30 11:50:49 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-30 11:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-30 11:50:49 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-30 11:50:49 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-30 11:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-30 11:50:49 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-30 11:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:53 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1767 | hits on page: 40
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for RB53949: 2
2026-03-30 11:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-30 11:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31cfe75-b57a-50f3-b353-36dc0366f07b with scrape type 2
2026-03-30 11:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b31cfe75-b57a-50f3-b353-36dc0366f07b with scrape type 2
2026-03-30 11:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b31cfe75-b57a-50f3-b353-36dc0366f07b, identifier: RB53949
2026-03-30 11:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-30 11:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-30 11:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949 to the API
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:26:20Z',
 'fuel_type': 'hybrid',
 'id': 'b31cfe75-b57a-50f3-b353-36dc0366f07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB53949',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 127220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'BMW 3er 320e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Saving data for RB53949: {'auction_closing_time': 1774884380.0, 'created_time': 1774557226.265258, 'last_price_update_time': 1774871453.537949}
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB53949') HTTP/1.1" 204 0
2026-03-30 11:50:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-30 11:50:53 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-30 11:50:53 [auto1.be] INFO: Scrape type for RK05604: 2
2026-03-30 11:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-30 11:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30c28b3-8de6-5b14-9f0d-0220db214618 with scrape type 2
2026-03-30 11:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f30c28b3-8de6-5b14-9f0d-0220db214618 with scrape type 2
2026-03-30 11:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f30c28b3-8de6-5b14-9f0d-0220db214618, identifier: RK05604
2026-03-30 11:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-30 11:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-30 11:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604 to the API
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:36Z',
 'fuel_type': 'diesel',
 'id': 'f30c28b3-8de6-5b14-9f0d-0220db214618',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK05604',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 142442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Saving data for RK05604: {'auction_closing_time': 1774885236.0, 'created_time': 1774557247.97669, 'last_price_update_time': 1774871454.036227}
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK05604') HTTP/1.1" 204 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for UD97693: 2
2026-03-30 11:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-30 11:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a99e162-f27d-56e2-a8f3-81cb4f738387 with scrape type 2
2026-03-30 11:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a99e162-f27d-56e2-a8f3-81cb4f738387 with scrape type 2
2026-03-30 11:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a99e162-f27d-56e2-a8f3-81cb4f738387, identifier: UD97693
2026-03-30 11:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-30 11:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-30 11:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693 to the API
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:50:14Z',
 'fuel_type': 'petrol',
 'id': '9a99e162-f27d-56e2-a8f3-81cb4f738387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD97693',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 134582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Saving data for UD97693: {'auction_closing_time': 1774885814.0, 'created_time': 1774557236.485623, 'last_price_update_time': 1774871454.489748}
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD97693') HTTP/1.1" 204 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-30 11:50:54 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-30 11:50:54 [auto1.be] INFO: Scrape type for WC10504: 2
2026-03-30 11:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-30 11:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dff6dc5-220c-5482-a920-fa14a7a119fe with scrape type 2
2026-03-30 11:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dff6dc5-220c-5482-a920-fa14a7a119fe with scrape type 2
2026-03-30 11:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5dff6dc5-220c-5482-a920-fa14a7a119fe, identifier: WC10504
2026-03-30 11:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-30 11:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-30 11:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504 to the API
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:22:49Z',
 'fuel_type': 'diesel',
 'id': '5dff6dc5-220c-5482-a920-fa14a7a119fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC10504',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 268796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-19',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi Active Adventure',
 'transmission': 'manual',
 'trim': 'Active Adventure',
 'year': 2008}
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-30 11:50:55 [auto1.be] INFO: Saving data for WC10504: {'auction_closing_time': 1774884169.0, 'created_time': 1774557240.030861, 'last_price_update_time': 1774871455.06312}
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC10504') HTTP/1.1" 204 0
2026-03-30 11:50:55 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-30 11:50:55 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-30 11:50:55 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-30 11:50:55 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-30 11:50:55 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-30 11:50:55 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-30 11:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:02 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for UT35373: 2
2026-03-30 11:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-30 11:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41313130-d5aa-5e0f-860b-8946e4f59d87 with scrape type 2
2026-03-30 11:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41313130-d5aa-5e0f-860b-8946e4f59d87 with scrape type 2
2026-03-30 11:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41313130-d5aa-5e0f-860b-8946e4f59d87, identifier: UT35373
2026-03-30 11:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-30 11:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-30 11:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373 to the API
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:52:51Z',
 'fuel_type': 'hybrid',
 'id': '41313130-d5aa-5e0f-860b-8946e4f59d87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT35373',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 223799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Saving data for UT35373: {'auction_closing_time': 1774885971.0, 'created_time': 1773237128.54277, 'last_price_update_time': 1774871462.796389}
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT35373') HTTP/1.1" 204 0
2026-03-30 11:51:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-30 11:51:02 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-30 11:51:02 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-30 11:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-30 11:51:03 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-30 11:51:03 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-30 11:51:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:04 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for KC69840: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-30 11:51:04 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-30 11:51:04 [auto1.be] INFO: Scrape type for VM06685: 2
2026-03-30 11:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685
2026-03-30 11:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with scrape type 2
2026-03-30 11:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with scrape type 2
2026-03-30 11:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8, identifier: VM06685
2026-03-30 11:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685
2026-03-30 11:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685
2026-03-30 11:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8 with identifier: VM06685 to the API
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:16Z',
 'fuel_type': 'diesel',
 'id': '9abc9d03-6d7f-53e3-8a78-74d3a5ae28e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM06685',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 173989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Saving data for VM06685: {'auction_closing_time': 1774885996.0, 'created_time': 1774513862.712195, 'last_price_update_time': 1774871465.347589}
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM06685') HTTP/1.1" 204 0
2026-03-30 11:51:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for JZ97752: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-30 11:51:05 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-30 11:51:05 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-30 11:51:07 [scrapy.extensions.logstats] INFO: Crawled 220 pages (at 7 pages/min), scraped 234 items (at 17 items/min)
2026-03-30 11:51:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:07 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:07 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-30 11:51:07 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-30 11:51:07 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-30 11:51:07 [auto1.be] INFO: Scrape type for MJ08102: 2
2026-03-30 11:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-30 11:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00232223-a846-5900-9a5b-3db495a38efc with scrape type 2
2026-03-30 11:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00232223-a846-5900-9a5b-3db495a38efc with scrape type 2
2026-03-30 11:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00232223-a846-5900-9a5b-3db495a38efc, identifier: MJ08102
2026-03-30 11:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-30 11:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-30 11:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102 to the API
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:48Z',
 'fuel_type': 'diesel',
 'id': '00232223-a846-5900-9a5b-3db495a38efc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ08102',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 320259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-12',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-30 11:51:07 [auto1.be] INFO: Saving data for MJ08102: {'auction_closing_time': 1774886268.0, 'created_time': 1774600269.800273, 'last_price_update_time': 1774871467.866727}
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ08102') HTTP/1.1" 204 0
2026-03-30 11:51:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:07 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-30 11:51:07 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-30 11:51:07 [auto1.be] INFO: Scrape type for CF04837: 2
2026-03-30 11:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-30 11:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with scrape type 2
2026-03-30 11:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with scrape type 2
2026-03-30 11:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0, identifier: CF04837
2026-03-30 11:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-30 11:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-30 11:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837 to the API
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:38:45Z',
 'fuel_type': 'hybrid',
 'id': '30986abb-ad7c-5ee6-95f7-7b9cf351f8c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF04837',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 54083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-11',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2021}
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Saving data for CF04837: {'auction_closing_time': 1774885125.0, 'created_time': 1774557210.236662, 'last_price_update_time': 1774871468.3559}
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF04837') HTTP/1.1" 204 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-30 11:51:08 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-30 11:51:08 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-30 11:51:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:44 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-30 11:51:44 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-30 11:51:44 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for XT87195: 2
2026-03-30 11:51:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-30 11:51:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8221b10a-9513-5872-a7dc-0ec12cdc3467 with scrape type 2
2026-03-30 11:51:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8221b10a-9513-5872-a7dc-0ec12cdc3467 with scrape type 2
2026-03-30 11:51:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8221b10a-9513-5872-a7dc-0ec12cdc3467, identifier: XT87195
2026-03-30 11:51:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-30 11:51:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-30 11:51:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195 to the API
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '8221b10a-9513-5872-a7dc-0ec12cdc3467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT87195',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 24623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Saving data for XT87195: {'auction_closing_time': 1774884726.0, 'created_time': 1773434044.28735, 'last_price_update_time': 1774871505.422348}
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT87195') HTTP/1.1" 204 0
2026-03-30 11:51:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-30 11:51:45 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-30 11:51:45 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-30 11:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:47 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:47 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-30 11:51:47 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-30 11:51:47 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-30 11:51:47 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-30 11:51:47 [auto1.be] INFO: Scrape type for VZ63754: 2
2026-03-30 11:51:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-30 11:51:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with scrape type 2
2026-03-30 11:51:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b64282ab-f6df-5cfe-9a69-a4be1e74ae50, identifier: VZ63754
2026-03-30 11:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-30 11:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-30 11:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754 to the API
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:30:40Z',
 'fuel_type': 'diesel',
 'id': 'b64282ab-f6df-5cfe-9a69-a4be1e74ae50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ63754',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 265866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Saving data for VZ63754: {'auction_closing_time': 1774884640.0, 'created_time': 1774600273.578802, 'last_price_update_time': 1774871508.368164}
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ63754') HTTP/1.1" 204 0
2026-03-30 11:51:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-30 11:51:48 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-30 11:51:48 [auto1.be] INFO: Scrape type for TZ99758: 2
2026-03-30 11:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-30 11:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with scrape type 2
2026-03-30 11:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18, identifier: TZ99758
2026-03-30 11:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-30 11:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-30 11:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758 to the API
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:58Z',
 'fuel_type': 'diesel',
 'id': '2e26ae23-3dfe-5205-8b2f-9f7e92de5b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ99758',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 95081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2021}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Saving data for TZ99758: {'auction_closing_time': 1774885978.0, 'created_time': 1774600286.277373, 'last_price_update_time': 1774871509.032112}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ99758') HTTP/1.1" 204 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for YS56392: 2
2026-03-30 11:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-30 11:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edcc5390-50a7-54b2-ad24-fd722dbd2608 with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edcc5390-50a7-54b2-ad24-fd722dbd2608 with scrape type 2
2026-03-30 11:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: edcc5390-50a7-54b2-ad24-fd722dbd2608, identifier: YS56392
2026-03-30 11:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-30 11:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-30 11:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392 to the API
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:10Z',
 'fuel_type': 'diesel',
 'id': 'edcc5390-50a7-54b2-ad24-fd722dbd2608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS56392',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 392142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Saving data for YS56392: {'auction_closing_time': 1774884430.0, 'created_time': 1774557198.346742, 'last_price_update_time': 1774871509.722619}
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS56392') HTTP/1.1" 204 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-30 11:51:49 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-30 11:51:49 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-30 11:51:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:50 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-30 11:51:50 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-30 11:51:50 [auto1.be] INFO: Scrape type for PR84870: 2
2026-03-30 11:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-30 11:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a517ed1f-1c9d-5773-a919-908f7dae6a5b with scrape type 2
2026-03-30 11:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a517ed1f-1c9d-5773-a919-908f7dae6a5b with scrape type 2
2026-03-30 11:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a517ed1f-1c9d-5773-a919-908f7dae6a5b, identifier: PR84870
2026-03-30 11:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-30 11:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-30 11:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870 to the API
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:05Z',
 'fuel_type': 'diesel',
 'id': 'a517ed1f-1c9d-5773-a919-908f7dae6a5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR84870',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 93347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2011}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Saving data for PR84870: {'auction_closing_time': 1774885265.0, 'created_time': 1773909033.045151, 'last_price_update_time': 1774871512.053452}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR84870') HTTP/1.1" 204 0
2026-03-30 11:51:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for JX00156: 2
2026-03-30 11:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-30 11:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b2242d-16f1-5264-84f4-9db8b53e18c0 with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9b2242d-16f1-5264-84f4-9db8b53e18c0 with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9b2242d-16f1-5264-84f4-9db8b53e18c0, identifier: JX00156
2026-03-30 11:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-30 11:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-30 11:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156 to the API
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:07:16Z',
 'fuel_type': 'petrol',
 'id': 'f9b2242d-16f1-5264-84f4-9db8b53e18c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX00156',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 76795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-02',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Comfort Blue',
 'transmission': 'manual',
 'trim': 'Comfort Blue',
 'year': 2012}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Saving data for JX00156: {'auction_closing_time': 1774883236.0, 'created_time': 1774600271.716595, 'last_price_update_time': 1774871512.692766}
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX00156') HTTP/1.1" 204 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-30 11:51:52 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-30 11:51:52 [auto1.be] INFO: Scrape type for LE69229: 2
2026-03-30 11:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-30 11:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155cb591-5e0a-54ad-b09e-9e57a683a273 with scrape type 2
2026-03-30 11:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155cb591-5e0a-54ad-b09e-9e57a683a273 with scrape type 2
2026-03-30 11:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 155cb591-5e0a-54ad-b09e-9e57a683a273, identifier: LE69229
2026-03-30 11:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-30 11:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-30 11:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229 to the API
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:03:14Z',
 'fuel_type': 'diesel',
 'id': '155cb591-5e0a-54ad-b09e-9e57a683a273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69229',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 155826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 CRDi App Mode',
 'transmission': 'manual',
 'trim': 'App Mode',
 'year': 2014}
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-30 11:51:53 [auto1.be] INFO: Saving data for LE69229: {'auction_closing_time': 1774882994.0, 'created_time': 1774557178.249835, 'last_price_update_time': 1774871513.300331}
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE69229') HTTP/1.1" 204 0
2026-03-30 11:51:53 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-30 11:51:53 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-30 11:51:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:51:54 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1767 | hits on page: 40
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Scrape type for DJ08738: 0
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Scrape type for FN69818: 2
2026-03-30 11:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-30 11:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67b4f29-ca49-576f-a62e-965446bc3ed3 with scrape type 2
2026-03-30 11:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67b4f29-ca49-576f-a62e-965446bc3ed3 with scrape type 2
2026-03-30 11:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b67b4f29-ca49-576f-a62e-965446bc3ed3, identifier: FN69818
2026-03-30 11:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-30 11:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-30 11:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818 to the API
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:03:51Z',
 'fuel_type': 'diesel',
 'id': 'b67b4f29-ca49-576f-a62e-965446bc3ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN69818',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 122497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2015}
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Saving data for FN69818: {'auction_closing_time': 1774883031.0, 'created_time': 1774600274.114139, 'last_price_update_time': 1774871514.833067}
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN69818') HTTP/1.1" 204 0
2026-03-30 11:51:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-30 11:51:54 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-30 11:51:54 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-30 11:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for SN22557: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for PS82481: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for MR51068: 2
2026-03-30 11:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-30 11:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cadc4e62-1ad2-559d-87f7-0b217b93ef9f with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cadc4e62-1ad2-559d-87f7-0b217b93ef9f with scrape type 2
2026-03-30 11:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cadc4e62-1ad2-559d-87f7-0b217b93ef9f, identifier: MR51068
2026-03-30 11:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-30 11:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-30 11:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068 to the API
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:16:34Z',
 'fuel_type': 'diesel',
 'id': 'cadc4e62-1ad2-559d-87f7-0b217b93ef9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR51068',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 146937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2017}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Saving data for MR51068: {'auction_closing_time': 1774883794.0, 'created_time': 1773301653.095499, 'last_price_update_time': 1774871515.473306}
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR51068') HTTP/1.1" 204 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for AZ39903: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for NL83155: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for PF94112: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for XT95399: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for NT98676: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for ZA12378: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for FJ54867: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for KD88013: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for YY44687: 0
2026-03-30 11:51:55 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-30 11:51:55 [auto1.be] INFO: Scrape type for BX66623: 0
2026-03-30 11:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:02 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for DM24490: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for PM87207: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for XW30503: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for UE36464: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for ER02883: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for HT18059: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for PE64709: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for ZM05640: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for KT01454: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for AC59433: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for GM68229: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for LK30146: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for UA37218: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for NZ75648: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for ER91021: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for EM88075: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for UV16393: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for AY92488: 0
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-30 11:52:02 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-30 11:52:02 [auto1.be] INFO: Scrape type for RL22884: 0
2026-03-30 11:52:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:07 [scrapy.extensions.logstats] INFO: Crawled 226 pages (at 6 pages/min), scraped 245 items (at 11 items/min)
2026-03-30 11:52:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:52:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:19 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for WH35268: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for DZ29736: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for ZN30582: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for DW89604: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for JB30712: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for XK23104: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for SG83875: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for UM29446: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-30 11:52:19 [auto1.be] INFO: Scrape type for XS20349: 0
2026-03-30 11:52:19 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for TA24587: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for MM51411: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for EM05161: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: US61524
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for DP44577: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for KU92863: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for XU79591: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for LM11563: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for VZ26705: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for GW19918: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for UY14877: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for GN49517: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for BE30988: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for LA99224: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for GJ36560: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for ER36240: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-30 11:52:20 [auto1.be] INFO: Scrape type for SD86163: 0
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-30 11:52:20 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-30 11:52:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:25 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1767 | hits on page: 40
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for BT92464: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for KG93945: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for HJ19751: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for JJ70860: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for JR09444: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for ET82729: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for HL00392: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for AU29077: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for FL05782: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for UY27001: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for CM21252: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for SU85893: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for DT20121: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for VM76060: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for TJ00131: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for VY36246: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for MJ04907: 0
2026-03-30 11:52:25 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-30 11:52:25 [auto1.be] INFO: Scrape type for YG03175: 0
2026-03-30 11:52:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:28 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1768 | hits on page: 40
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for YG03175: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for UG65181: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for KT35610: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for GH80996: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for ZY24236: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for ZZ74713: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for XD67660: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for DT55223: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for EL95031: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for UX01518: 0
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for EK14732: 2
2026-03-30 11:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732
2026-03-30 11:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb0e50d-5171-51f2-aac4-e266009560e3 with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceb0e50d-5171-51f2-aac4-e266009560e3 with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ceb0e50d-5171-51f2-aac4-e266009560e3, identifier: EK14732
2026-03-30 11:52:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732
2026-03-30 11:52:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732
2026-03-30 11:52:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ceb0e50d-5171-51f2-aac4-e266009560e3 with identifier: EK14732 to the API
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:59:14Z',
 'fuel_type': 'petrol',
 'id': 'ceb0e50d-5171-51f2-aac4-e266009560e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK14732',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 98478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-08',
 'seller_name': None,
 'title': 'Dacia Logan 1.2 Black Line 2',
 'transmission': 'manual',
 'trim': 'Black Line 2',
 'year': 2012}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Saving data for EK14732: {'auction_closing_time': 1774886354.0, 'created_time': 1774697486.612962, 'last_price_update_time': 1774871548.845932}
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK14732') HTTP/1.1" 204 0
2026-03-30 11:52:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-30 11:52:28 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-30 11:52:28 [auto1.be] INFO: Scrape type for UR02836: 2
2026-03-30 11:52:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836
2026-03-30 11:52:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with scrape type 2
2026-03-30 11:52:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e, identifier: UR02836
2026-03-30 11:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836
2026-03-30 11:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836
2026-03-30 11:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b8f9d8e-56d3-501a-a3bf-fd247e39458e with identifier: UR02836 to the API
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'diesel',
 'id': '9b8f9d8e-56d3-501a-a3bf-fd247e39458e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR02836',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 202781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.be] INFO: Saving data for UR02836: {'auction_closing_time': 1774884544.0, 'created_time': 1774697480.864288, 'last_price_update_time': 1774871549.358976}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR02836') HTTP/1.1" 204 0
2026-03-30 11:52:29 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.be] INFO: Scrape type for XK01311: 2
2026-03-30 11:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311
2026-03-30 11:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee, identifier: XK01311
2026-03-30 11:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311
2026-03-30 11:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311
2026-03-30 11:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4d70a71-daf1-5172-8ed9-705eaa3cd3ee with identifier: XK01311 to the API
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:12Z',
 'fuel_type': 'diesel',
 'id': 'f4d70a71-daf1-5172-8ed9-705eaa3cd3ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK01311',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 174287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2016}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.be] INFO: Saving data for XK01311: {'auction_closing_time': 1774883232.0, 'created_time': 1774002094.431217, 'last_price_update_time': 1774871549.753758}
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK01311') HTTP/1.1" 204 0
2026-03-30 11:52:29 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-30 11:52:29 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-30 11:52:29 [auto1.be] INFO: Scrape type for ED41371: 2
2026-03-30 11:52:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371
2026-03-30 11:52:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with scrape type 2
2026-03-30 11:52:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575, identifier: ED41371
2026-03-30 11:52:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371
2026-03-30 11:52:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371
2026-03-30 11:52:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56e2555b-3ba3-5f4c-9f51-72b6b25cc575 with identifier: ED41371 to the API
2026-03-30 11:52:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:27:40Z',
 'fuel_type': 'petrol',
 'id': '56e2555b-3ba3-5f4c-9f51-72b6b25cc575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED41371',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 104745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play',
 'transmission': 'manual',
 'trim': 'X-Play',
 'year': 2017}
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-30 11:52:30 [auto1.be] INFO: Saving data for ED41371: {'auction_closing_time': 1774884460.0, 'created_time': 1773348518.221899, 'last_price_update_time': 1774871550.157309}
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED41371') HTTP/1.1" 204 0
2026-03-30 11:52:30 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-30 11:52:30 [auto1.be] INFO: Scrape type for VX51166: 2
2026-03-30 11:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166
2026-03-30 11:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with scrape type 2
2026-03-30 11:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with scrape type 2
2026-03-30 11:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3f1acef5-aad0-5707-b995-cc1bd85f4d16, identifier: VX51166
2026-03-30 11:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166
2026-03-30 11:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166
2026-03-30 11:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3f1acef5-aad0-5707-b995-cc1bd85f4d16 with identifier: VX51166 to the API
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:55Z',
 'fuel_type': 'diesel',
 'id': '3f1acef5-aad0-5707-b995-cc1bd85f4d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX51166',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 224668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-30 11:52:30 [auto1.be] INFO: Saving data for VX51166: {'auction_closing_time': 1774885915.0, 'created_time': 1774697486.232844, 'last_price_update_time': 1774871550.547132}
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VX51166') HTTP/1.1" 204 0
2026-03-30 11:52:30 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-30 11:52:30 [auto1.be] INFO: Scrape type for BD29807: 2
2026-03-30 11:52:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807
2026-03-30 11:52:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with scrape type 2
2026-03-30 11:52:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with scrape type 2
2026-03-30 11:52:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3, identifier: BD29807
2026-03-30 11:52:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807
2026-03-30 11:52:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807
2026-03-30 11:52:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2d6e7b1-b46c-568d-ae50-09a5e955b1f3 with identifier: BD29807 to the API
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:44:05Z',
 'fuel_type': 'petrol',
 'id': 'f2d6e7b1-b46c-568d-ae50-09a5e955b1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD29807',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 153863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2019}
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-30 11:52:30 [auto1.be] INFO: Saving data for BD29807: {'auction_closing_time': 1774885445.0, 'created_time': 1774697433.450077, 'last_price_update_time': 1774871550.964261}
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD29807') HTTP/1.1" 204 0
2026-03-30 11:52:30 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-30 11:52:30 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-30 11:52:30 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-30 11:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-30 11:52:31 [auto1.be] INFO: Scrape type for ZJ26009: 2
2026-03-30 11:52:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009
2026-03-30 11:52:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef856ef4-db6c-5637-9d07-afdae111ee37 with scrape type 2
2026-03-30 11:52:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef856ef4-db6c-5637-9d07-afdae111ee37 with scrape type 2
2026-03-30 11:52:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef856ef4-db6c-5637-9d07-afdae111ee37, identifier: ZJ26009
2026-03-30 11:52:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009
2026-03-30 11:52:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009
2026-03-30 11:52:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef856ef4-db6c-5637-9d07-afdae111ee37 with identifier: ZJ26009 to the API
2026-03-30 11:52:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:42:15Z',
 'fuel_type': 'petrol',
 'id': 'ef856ef4-db6c-5637-9d07-afdae111ee37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ26009',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 35034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-09',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2021}
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Saving data for ZJ26009: {'auction_closing_time': 1774885335.0, 'created_time': 1774697489.461663, 'last_price_update_time': 1774871552.027533}
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ26009') HTTP/1.1" 204 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for LR36013: 2
2026-03-30 11:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013
2026-03-30 11:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7851fcd-848f-552e-bb27-09862abc5ccc with scrape type 2
2026-03-30 11:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7851fcd-848f-552e-bb27-09862abc5ccc with scrape type 2
2026-03-30 11:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7851fcd-848f-552e-bb27-09862abc5ccc, identifier: LR36013
2026-03-30 11:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013
2026-03-30 11:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013
2026-03-30 11:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7851fcd-848f-552e-bb27-09862abc5ccc with identifier: LR36013 to the API
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:45:31Z',
 'fuel_type': 'diesel',
 'id': 'c7851fcd-848f-552e-bb27-09862abc5ccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR36013',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 184712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-08',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Saving data for LR36013: {'auction_closing_time': 1774885531.0, 'created_time': 1774697489.840527, 'last_price_update_time': 1774871552.437306}
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LR36013') HTTP/1.1" 204 0
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-30 11:52:32 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Scrape type for TX50404: 2
2026-03-30 11:52:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404
2026-03-30 11:52:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with scrape type 2
2026-03-30 11:52:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with scrape type 2
2026-03-30 11:52:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115, identifier: TX50404
2026-03-30 11:52:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404
2026-03-30 11:52:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404
2026-03-30 11:52:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115 with identifier: TX50404 to the API
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'petrol',
 'id': 'dd6d91a8-5a11-5ec4-a3ec-c801e4ef1115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX50404',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 62939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-11',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2020}
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-30 11:52:32 [auto1.be] INFO: Saving data for TX50404: {'auction_closing_time': 1774884476.0, 'created_time': 1774697484.229791, 'last_price_update_time': 1774871552.989797}
2026-03-30 11:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX50404') HTTP/1.1" 204 0
2026-03-30 11:52:33 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-30 11:52:33 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-30 11:52:33 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-30 11:52:33 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-30 11:52:33 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 11:52:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:37 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1769 | hits on page: 40
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-30 11:52:37 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-30 11:52:37 [auto1.be] INFO: Scrape type for HR69689: 2
2026-03-30 11:52:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689
2026-03-30 11:52:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6e0103-20c0-5073-8551-c220d276f1a5 with scrape type 2
2026-03-30 11:52:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d6e0103-20c0-5073-8551-c220d276f1a5 with scrape type 2
2026-03-30 11:52:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d6e0103-20c0-5073-8551-c220d276f1a5, identifier: HR69689
2026-03-30 11:52:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689
2026-03-30 11:52:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689
2026-03-30 11:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d6e0103-20c0-5073-8551-c220d276f1a5 with identifier: HR69689 to the API
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': '7d6e0103-20c0-5073-8551-c220d276f1a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR69689',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 79043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-31',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2010}
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Saving data for HR69689: {'auction_closing_time': 1774883395.0, 'created_time': 1774697473.760001, 'last_price_update_time': 1774871558.584653}
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HR69689') HTTP/1.1" 204 0
2026-03-30 11:52:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-30 11:52:38 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-30 11:52:38 [auto1.be] INFO: Scrape type for FC15884: 2
2026-03-30 11:52:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884
2026-03-30 11:52:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db27fa81-3445-51c1-b94d-aaec429fceac with scrape type 2
2026-03-30 11:52:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db27fa81-3445-51c1-b94d-aaec429fceac with scrape type 2
2026-03-30 11:52:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db27fa81-3445-51c1-b94d-aaec429fceac, identifier: FC15884
2026-03-30 11:52:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884
2026-03-30 11:52:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884
2026-03-30 11:52:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db27fa81-3445-51c1-b94d-aaec429fceac with identifier: FC15884 to the API
2026-03-30 11:52:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:33:14Z',
 'fuel_type': 'diesel',
 'id': 'db27fa81-3445-51c1-b94d-aaec429fceac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC15884',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 31108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Asphalt L3',
 'transmission': 'automatic',
 'trim': 'Asphalt L3',
 'year': 2022}
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Saving data for FC15884: {'auction_closing_time': 1774884794.0, 'created_time': 1774697437.203711, 'last_price_update_time': 1774871559.115649}
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC15884') HTTP/1.1" 204 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for KX73156: 2
2026-03-30 11:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156
2026-03-30 11:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d4b38b4-c5ac-582c-8269-3dfe1108d249, identifier: KX73156
2026-03-30 11:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156
2026-03-30 11:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156
2026-03-30 11:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d4b38b4-c5ac-582c-8269-3dfe1108d249 with identifier: KX73156 to the API
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:30Z',
 'fuel_type': 'diesel',
 'id': '2d4b38b4-c5ac-582c-8269-3dfe1108d249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX73156',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 70999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-03',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2019}
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Saving data for KX73156: {'auction_closing_time': 1774882950.0, 'created_time': 1774697476.263605, 'last_price_update_time': 1774871559.492727}
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX73156') HTTP/1.1" 204 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for SZ00073: 2
2026-03-30 11:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073
2026-03-30 11:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c, identifier: SZ00073
2026-03-30 11:52:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073
2026-03-30 11:52:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073
2026-03-30 11:52:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c080186-d2ca-5851-8ae0-8f66b1f9b21c with identifier: SZ00073 to the API
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:55Z',
 'fuel_type': 'petrol',
 'id': '1c080186-d2ca-5851-8ae0-8f66b1f9b21c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ00073',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 101307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2016}
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Saving data for SZ00073: {'auction_closing_time': 1774883215.0, 'created_time': 1774038857.097012, 'last_price_update_time': 1774871559.888126}
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ00073') HTTP/1.1" 204 0
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-30 11:52:39 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-30 11:52:39 [auto1.be] INFO: Scrape type for CA73486: 2
2026-03-30 11:52:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486
2026-03-30 11:52:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9970f351-8e7b-5b05-806e-ef9f53ff2274 with scrape type 2
2026-03-30 11:52:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9970f351-8e7b-5b05-806e-ef9f53ff2274 with scrape type 2
2026-03-30 11:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9970f351-8e7b-5b05-806e-ef9f53ff2274, identifier: CA73486
2026-03-30 11:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486
2026-03-30 11:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486
2026-03-30 11:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9970f351-8e7b-5b05-806e-ef9f53ff2274 with identifier: CA73486 to the API
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:17:12Z',
 'fuel_type': 'diesel',
 'id': '9970f351-8e7b-5b05-806e-ef9f53ff2274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA73486',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 202567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2015}
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-30 11:52:40 [auto1.be] INFO: Saving data for CA73486: {'auction_closing_time': 1774883832.0, 'created_time': 1774697478.778698, 'last_price_update_time': 1774871560.283221}
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA73486') HTTP/1.1" 204 0
2026-03-30 11:52:40 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-30 11:52:40 [auto1.be] INFO: Scrape type for NU74968: 2
2026-03-30 11:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968
2026-03-30 11:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41735558-5028-59dd-8be8-4f433bed79b2 with scrape type 2
2026-03-30 11:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41735558-5028-59dd-8be8-4f433bed79b2 with scrape type 2
2026-03-30 11:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41735558-5028-59dd-8be8-4f433bed79b2, identifier: NU74968
2026-03-30 11:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968
2026-03-30 11:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968
2026-03-30 11:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41735558-5028-59dd-8be8-4f433bed79b2 with identifier: NU74968 to the API
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:28Z',
 'fuel_type': 'petrol',
 'id': '41735558-5028-59dd-8be8-4f433bed79b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU74968',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 61029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Turbo Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2019}
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-30 11:52:40 [auto1.be] INFO: Saving data for NU74968: {'auction_closing_time': 1774886248.0, 'created_time': 1774697435.785873, 'last_price_update_time': 1774871560.66567}
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU74968') HTTP/1.1" 204 0
2026-03-30 11:52:40 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-30 11:52:40 [auto1.be] INFO: Scrape type for WX14373: 2
2026-03-30 11:52:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373
2026-03-30 11:52:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3c260f-b0af-54bb-993a-3c6407d64d3d with scrape type 2
2026-03-30 11:52:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee3c260f-b0af-54bb-993a-3c6407d64d3d with scrape type 2
2026-03-30 11:52:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee3c260f-b0af-54bb-993a-3c6407d64d3d, identifier: WX14373
2026-03-30 11:52:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373
2026-03-30 11:52:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373
2026-03-30 11:52:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee3c260f-b0af-54bb-993a-3c6407d64d3d with identifier: WX14373 to the API
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:03:30Z',
 'fuel_type': 'hybrid',
 'id': 'ee3c260f-b0af-54bb-993a-3c6407d64d3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX14373',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 125159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2019}
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.be] INFO: Saving data for WX14373: {'auction_closing_time': 1774883010.0, 'created_time': 1774697435.38496, 'last_price_update_time': 1774871561.082944}
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WX14373') HTTP/1.1" 204 0
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.be] INFO: Scrape type for SW60531: 2
2026-03-30 11:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531
2026-03-30 11:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad36dce-515d-550b-8443-24c9c28ed4fc with scrape type 2
2026-03-30 11:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad36dce-515d-550b-8443-24c9c28ed4fc with scrape type 2
2026-03-30 11:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aad36dce-515d-550b-8443-24c9c28ed4fc, identifier: SW60531
2026-03-30 11:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531
2026-03-30 11:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531
2026-03-30 11:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aad36dce-515d-550b-8443-24c9c28ed4fc with identifier: SW60531 to the API
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'diesel',
 'id': 'aad36dce-515d-550b-8443-24c9c28ed4fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW60531',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 140536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-03',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2018}
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.be] INFO: Saving data for SW60531: {'auction_closing_time': 1774885097.0, 'created_time': 1774697499.610529, 'last_price_update_time': 1774871561.451259}
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW60531') HTTP/1.1" 204 0
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.be] INFO: Scrape type for KH65741: 2
2026-03-30 11:52:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741
2026-03-30 11:52:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f with scrape type 2
2026-03-30 11:52:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651bb9bb-9b15-56ef-a72b-a707d51eb51f with scrape type 2
2026-03-30 11:52:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 651bb9bb-9b15-56ef-a72b-a707d51eb51f, identifier: KH65741
2026-03-30 11:52:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741
2026-03-30 11:52:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741
2026-03-30 11:52:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 651bb9bb-9b15-56ef-a72b-a707d51eb51f with identifier: KH65741 to the API
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'petrol',
 'id': '651bb9bb-9b15-56ef-a72b-a707d51eb51f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH65741',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 73827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-17',
 'seller_name': None,
 'title': "Kia cee'd 1.6 Active",
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.be] INFO: Saving data for KH65741: {'auction_closing_time': 1774883761.0, 'created_time': 1774697497.908294, 'last_price_update_time': 1774871561.966293}
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH65741') HTTP/1.1" 204 0
2026-03-30 11:52:41 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-30 11:52:42 [auto1.be] INFO: Scrape type for JJ51820: 2
2026-03-30 11:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820
2026-03-30 11:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 104696d1-0028-576f-9f9e-e905b7c8a95f with scrape type 2
2026-03-30 11:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 104696d1-0028-576f-9f9e-e905b7c8a95f with scrape type 2
2026-03-30 11:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 104696d1-0028-576f-9f9e-e905b7c8a95f, identifier: JJ51820
2026-03-30 11:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820
2026-03-30 11:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820
2026-03-30 11:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 104696d1-0028-576f-9f9e-e905b7c8a95f with identifier: JJ51820 to the API
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'petrol',
 'id': '104696d1-0028-576f-9f9e-e905b7c8a95f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ51820',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 86542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'BMW 5er 530i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-30 11:52:42 [auto1.be] INFO: Saving data for JJ51820: {'auction_closing_time': 1774883000.0, 'created_time': 1774697496.191657, 'last_price_update_time': 1774871562.346589}
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ51820') HTTP/1.1" 204 0
2026-03-30 11:52:42 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-30 11:52:42 [auto1.be] INFO: Scrape type for CV58665: 2
2026-03-30 11:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665
2026-03-30 11:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with scrape type 2
2026-03-30 11:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with scrape type 2
2026-03-30 11:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2, identifier: CV58665
2026-03-30 11:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665
2026-03-30 11:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665
2026-03-30 11:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2 with identifier: CV58665 to the API
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:46:03Z',
 'fuel_type': 'petrol',
 'id': '395edcd1-1f5d-5e3f-8e7b-bf37fa6438d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV58665',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 105434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seller_name': None,
 'title': 'MINI Cabrio One',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-30 11:52:42 [auto1.be] INFO: Saving data for CV58665: {'auction_closing_time': 1774885563.0, 'created_time': 1774697494.488421, 'last_price_update_time': 1774871562.733161}
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CV58665') HTTP/1.1" 204 0
2026-03-30 11:52:42 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-30 11:52:42 [auto1.be] INFO: Scrape type for NE94103: 2
2026-03-30 11:52:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103
2026-03-30 11:52:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab with scrape type 2
2026-03-30 11:52:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed6ad94f-670c-5b81-852b-8f1e7fab46ab with scrape type 2
2026-03-30 11:52:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ed6ad94f-670c-5b81-852b-8f1e7fab46ab, identifier: NE94103
2026-03-30 11:52:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103
2026-03-30 11:52:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103
2026-03-30 11:52:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ed6ad94f-670c-5b81-852b-8f1e7fab46ab with identifier: NE94103 to the API
2026-03-30 11:52:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-30T15:38:11Z',
 'fuel_type': 'petrol',
 'id': 'ed6ad94f-670c-5b81-852b-8f1e7fab46ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE94103',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 231348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-05',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo Innovation 4x4',
 'transmission': 'automatic',
 'trim': 'Innovation 4x4',
 'year': 2011}
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-30 11:52:43 [auto1.be] INFO: Saving data for NE94103: {'auction_closing_time': 1774885091.0, 'created_time': 1774697492.018195, 'last_price_update_time': 1774871563.119285}
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE94103') HTTP/1.1" 204 0
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-30 11:52:43 [auto1.be] INFO: Scrape type for RC51689: 2
2026-03-30 11:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689
2026-03-30 11:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 771730b6-0b82-5d01-8b53-b1a8ab9642af with scrape type 2
2026-03-30 11:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 771730b6-0b82-5d01-8b53-b1a8ab9642af with scrape type 2
2026-03-30 11:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 771730b6-0b82-5d01-8b53-b1a8ab9642af, identifier: RC51689
2026-03-30 11:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689
2026-03-30 11:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689
2026-03-30 11:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 771730b6-0b82-5d01-8b53-b1a8ab9642af with identifier: RC51689 to the API
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:14Z',
 'fuel_type': 'petrol',
 'id': '771730b6-0b82-5d01-8b53-b1a8ab9642af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC51689',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 108544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-28',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-30 11:52:43 [auto1.be] INFO: Saving data for RC51689: {'auction_closing_time': 1774885274.0, 'created_time': 1774697497.530769, 'last_price_update_time': 1774871563.503801}
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC51689') HTTP/1.1" 204 0
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-30 11:52:43 [auto1.be] INFO: Scrape type for KB41449: 2
2026-03-30 11:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449
2026-03-30 11:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f12160-f078-597b-82c3-d3f29410dc70 with scrape type 2
2026-03-30 11:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43f12160-f078-597b-82c3-d3f29410dc70 with scrape type 2
2026-03-30 11:52:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43f12160-f078-597b-82c3-d3f29410dc70, identifier: KB41449
2026-03-30 11:52:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449
2026-03-30 11:52:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449
2026-03-30 11:52:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43f12160-f078-597b-82c3-d3f29410dc70 with identifier: KB41449 to the API
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:46Z',
 'fuel_type': 'petrol',
 'id': '43f12160-f078-597b-82c3-d3f29410dc70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB41449',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 93997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-30 11:52:43 [auto1.be] INFO: Saving data for KB41449: {'auction_closing_time': 1774884466.0, 'created_time': 1774697494.088767, 'last_price_update_time': 1774871563.919733}
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB41449') HTTP/1.1" 204 0
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-30 11:52:43 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-30 11:52:43 [auto1.be] INFO: Scrape type for JU94491: 2
2026-03-30 11:52:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491
2026-03-30 11:52:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf55a91-a1a3-58c3-b51d-8ff5bea44810 with scrape type 2
2026-03-30 11:52:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf55a91-a1a3-58c3-b51d-8ff5bea44810 with scrape type 2
2026-03-30 11:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acf55a91-a1a3-58c3-b51d-8ff5bea44810, identifier: JU94491
2026-03-30 11:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491
2026-03-30 11:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491
2026-03-30 11:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acf55a91-a1a3-58c3-b51d-8ff5bea44810 with identifier: JU94491 to the API
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:49:56Z',
 'fuel_type': 'diesel',
 'id': 'acf55a91-a1a3-58c3-b51d-8ff5bea44810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU94491',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 226297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-30 11:52:44 [auto1.be] INFO: Saving data for JU94491: {'auction_closing_time': 1774885796.0, 'created_time': 1774697492.777255, 'last_price_update_time': 1774871564.327999}
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU94491') HTTP/1.1" 204 0
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-30 11:52:44 [auto1.be] INFO: Scrape type for PU93740: 2
2026-03-30 11:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740
2026-03-30 11:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with scrape type 2
2026-03-30 11:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with scrape type 2
2026-03-30 11:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d17c10e0-e10f-521d-81c0-79a0f63ac5a0, identifier: PU93740
2026-03-30 11:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740
2026-03-30 11:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740
2026-03-30 11:52:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d17c10e0-e10f-521d-81c0-79a0f63ac5a0 with identifier: PU93740 to the API
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:57:51Z',
 'fuel_type': 'petrol',
 'id': 'd17c10e0-e10f-521d-81c0-79a0f63ac5a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU93740',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 161164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-11',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-30 11:52:44 [auto1.be] INFO: Saving data for PU93740: {'auction_closing_time': 1774886271.0, 'created_time': 1774697495.135218, 'last_price_update_time': 1774871564.790318}
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PU93740') HTTP/1.1" 204 0
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-30 11:52:44 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-30 11:52:44 [auto1.be] INFO: Scrape type for XG70738: 2
2026-03-30 11:52:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738
2026-03-30 11:52:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4348a1dc-8057-530c-a3dd-516db4e90c09 with scrape type 2
2026-03-30 11:52:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4348a1dc-8057-530c-a3dd-516db4e90c09 with scrape type 2
2026-03-30 11:52:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4348a1dc-8057-530c-a3dd-516db4e90c09, identifier: XG70738
2026-03-30 11:52:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738
2026-03-30 11:52:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738
2026-03-30 11:52:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4348a1dc-8057-530c-a3dd-516db4e90c09 with identifier: XG70738 to the API
2026-03-30 11:52:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:52:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:52:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:43Z',
 'fuel_type': 'diesel',
 'id': '4348a1dc-8057-530c-a3dd-516db4e90c09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG70738',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 160095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Business Eco2',
 'transmission': 'manual',
 'trim': 'Business Eco2',
 'year': 2014}
2026-03-30 11:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-30 11:52:45 [auto1.be] INFO: Saving data for XG70738: {'auction_closing_time': 1774886203.0, 'created_time': 1774697468.465194, 'last_price_update_time': 1774871565.640212}
2026-03-30 11:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG70738') HTTP/1.1" 204 0
2026-03-30 11:52:45 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 11:53:07 [scrapy.extensions.logstats] INFO: Crawled 230 pages (at 4 pages/min), scraped 271 items (at 26 items/min)
2026-03-30 11:53:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:54:07 [scrapy.extensions.logstats] INFO: Crawled 230 pages (at 0 pages/min), scraped 271 items (at 0 items/min)
2026-03-30 11:54:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:54:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.028(s), this was the 1st time calling it.
2026-03-30 11:54:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.286242201794367 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:54:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:54:59 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1771 | hits on page: 40
2026-03-30 11:54:59 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 11:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-30 11:54:59 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-30 11:54:59 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 11:54:59 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-30 11:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:54:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-30 11:54:59 [auto1.be] INFO: Scrape type for GV92885: 2
2026-03-30 11:54:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885
2026-03-30 11:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f1525d-7fab-55ed-ac31-bf203cdec17c with scrape type 2
2026-03-30 11:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5f1525d-7fab-55ed-ac31-bf203cdec17c with scrape type 2
2026-03-30 11:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5f1525d-7fab-55ed-ac31-bf203cdec17c, identifier: GV92885
2026-03-30 11:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885
2026-03-30 11:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885
2026-03-30 11:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5f1525d-7fab-55ed-ac31-bf203cdec17c with identifier: GV92885 to the API
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:20Z',
 'fuel_type': 'petrol',
 'id': 'b5f1525d-7fab-55ed-ac31-bf203cdec17c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV92885',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 119374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-27',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2016}
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-30 11:55:00 [auto1.be] INFO: Saving data for GV92885: {'auction_closing_time': 1774885880.0, 'created_time': 1774697485.313745, 'last_price_update_time': 1774871700.353169}
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV92885') HTTP/1.1" 204 0
2026-03-30 11:55:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-30 11:55:00 [auto1.be] INFO: Scrape type for DV83163: 2
2026-03-30 11:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163
2026-03-30 11:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca522015-fe64-56f6-b3aa-280f5acec4b2 with scrape type 2
2026-03-30 11:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca522015-fe64-56f6-b3aa-280f5acec4b2 with scrape type 2
2026-03-30 11:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca522015-fe64-56f6-b3aa-280f5acec4b2, identifier: DV83163
2026-03-30 11:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163
2026-03-30 11:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163
2026-03-30 11:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca522015-fe64-56f6-b3aa-280f5acec4b2 with identifier: DV83163 to the API
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:34Z',
 'fuel_type': 'petrol',
 'id': 'ca522015-fe64-56f6-b3aa-280f5acec4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV83163',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 81993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-24',
 'seller_name': None,
 'title': 'Chevrolet Cruze 1.6 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-30 11:55:00 [auto1.be] INFO: Saving data for DV83163: {'auction_closing_time': 1774884634.0, 'created_time': 1774697484.949763, 'last_price_update_time': 1774871700.860227}
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DV83163') HTTP/1.1" 204 0
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-30 11:55:00 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-30 11:55:00 [auto1.be] INFO: Scrape type for AF15006: 2
2026-03-30 11:55:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006
2026-03-30 11:55:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with scrape type 2
2026-03-30 11:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with scrape type 2
2026-03-30 11:55:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ccfde9e-ced9-544b-b4ad-1e5d61052570, identifier: AF15006
2026-03-30 11:55:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006
2026-03-30 11:55:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006
2026-03-30 11:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ccfde9e-ced9-544b-b4ad-1e5d61052570 with identifier: AF15006 to the API
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:32:58Z',
 'fuel_type': 'diesel',
 'id': '8ccfde9e-ced9-544b-b4ad-1e5d61052570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF15006',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 87492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-31',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2022}
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-30 11:55:01 [auto1.be] INFO: Saving data for AF15006: {'auction_closing_time': 1774884778.0, 'created_time': 1774697460.013723, 'last_price_update_time': 1774871701.273826}
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF15006') HTTP/1.1" 204 0
2026-03-30 11:55:01 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-30 11:55:01 [auto1.be] INFO: Scrape type for JY19882: 2
2026-03-30 11:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882
2026-03-30 11:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7159a46c-2b19-5f82-b1c8-43101d26062f with scrape type 2
2026-03-30 11:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7159a46c-2b19-5f82-b1c8-43101d26062f with scrape type 2
2026-03-30 11:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7159a46c-2b19-5f82-b1c8-43101d26062f, identifier: JY19882
2026-03-30 11:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882
2026-03-30 11:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882
2026-03-30 11:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7159a46c-2b19-5f82-b1c8-43101d26062f with identifier: JY19882 to the API
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:15Z',
 'fuel_type': 'diesel',
 'id': '7159a46c-2b19-5f82-b1c8-43101d26062f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY19882',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 200111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-01',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-30 11:55:01 [auto1.be] INFO: Saving data for JY19882: {'auction_closing_time': 1774883295.0, 'created_time': 1774697454.767282, 'last_price_update_time': 1774871701.756553}
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY19882') HTTP/1.1" 204 0
2026-03-30 11:55:01 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-30 11:55:01 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-30 11:55:01 [auto1.be] INFO: Scrape type for JZ80953: 2
2026-03-30 11:55:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953
2026-03-30 11:55:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498fe583-9687-5692-9bb0-ea4a8b82d27b with scrape type 2
2026-03-30 11:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 498fe583-9687-5692-9bb0-ea4a8b82d27b with scrape type 2
2026-03-30 11:55:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 498fe583-9687-5692-9bb0-ea4a8b82d27b, identifier: JZ80953
2026-03-30 11:55:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953
2026-03-30 11:55:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953
2026-03-30 11:55:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 498fe583-9687-5692-9bb0-ea4a8b82d27b with identifier: JZ80953 to the API
2026-03-30 11:55:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'hybrid',
 'id': '498fe583-9687-5692-9bb0-ea4a8b82d27b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ80953',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 62410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Elegant',
 'transmission': 'automatic',
 'trim': '2WD Elegant',
 'year': 2022}
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-30 11:55:03 [auto1.be] INFO: Saving data for JZ80953: {'auction_closing_time': 1774883764.0, 'created_time': 1774697458.715039, 'last_price_update_time': 1774871703.262539}
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ80953') HTTP/1.1" 204 0
2026-03-30 11:55:03 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-30 11:55:03 [auto1.be] INFO: Scrape type for TL44110: 2
2026-03-30 11:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110
2026-03-30 11:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45435a5d-55bf-5d90-9521-d4c4d94d657a with scrape type 2
2026-03-30 11:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45435a5d-55bf-5d90-9521-d4c4d94d657a with scrape type 2
2026-03-30 11:55:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45435a5d-55bf-5d90-9521-d4c4d94d657a, identifier: TL44110
2026-03-30 11:55:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110
2026-03-30 11:55:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110
2026-03-30 11:55:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45435a5d-55bf-5d90-9521-d4c4d94d657a with identifier: TL44110 to the API
2026-03-30 11:55:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'diesel',
 'id': '45435a5d-55bf-5d90-9521-d4c4d94d657a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL44110',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 174075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-01',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Tendance',
 'transmission': 'automatic',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-30 11:55:04 [auto1.be] INFO: Saving data for TL44110: {'auction_closing_time': 1774884601.0, 'created_time': 1774697464.855446, 'last_price_update_time': 1774871704.155733}
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL44110') HTTP/1.1" 204 0
2026-03-30 11:55:04 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-30 11:55:04 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-30 11:55:04 [auto1.be] INFO: Scrape type for FC31614: 2
2026-03-30 11:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614
2026-03-30 11:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c308775-4db8-55d1-af91-dc9daebcc7bf with scrape type 2
2026-03-30 11:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c308775-4db8-55d1-af91-dc9daebcc7bf with scrape type 2
2026-03-30 11:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c308775-4db8-55d1-af91-dc9daebcc7bf, identifier: FC31614
2026-03-30 11:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614
2026-03-30 11:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614
2026-03-30 11:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c308775-4db8-55d1-af91-dc9daebcc7bf with identifier: FC31614 to the API
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:38Z',
 'fuel_type': 'petrol',
 'id': '5c308775-4db8-55d1-af91-dc9daebcc7bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC31614',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 44615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna +',
 'transmission': 'automatic',
 'trim': 'Tekna +',
 'year': 2017}
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-30 11:55:04 [auto1.be] INFO: Saving data for FC31614: {'auction_closing_time': 1774885118.0, 'created_time': 1774697471.096106, 'last_price_update_time': 1774871704.687852}
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC31614') HTTP/1.1" 204 0
2026-03-30 11:55:04 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-30 11:55:04 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-30 11:55:04 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-30 11:55:04 [auto1.be] INFO: Scrape type for CU06988: 2
2026-03-30 11:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988
2026-03-30 11:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with scrape type 2
2026-03-30 11:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with scrape type 2
2026-03-30 11:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d8a5f1d-43b3-505c-80cd-d892bccfe986, identifier: CU06988
2026-03-30 11:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988
2026-03-30 11:55:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988
2026-03-30 11:55:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d8a5f1d-43b3-505c-80cd-d892bccfe986 with identifier: CU06988 to the API
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:06:02Z',
 'fuel_type': 'hybrid',
 'id': '8d8a5f1d-43b3-505c-80cd-d892bccfe986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU06988',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 68299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-14',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2017}
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-30 11:55:05 [auto1.be] INFO: Saving data for CU06988: {'auction_closing_time': 1774883162.0, 'created_time': 1774697481.324326, 'last_price_update_time': 1774871705.095017}
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU06988') HTTP/1.1" 204 0
2026-03-30 11:55:05 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-30 11:55:05 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-30 11:55:05 [auto1.be] INFO: Scrape type for KH04328: 2
2026-03-30 11:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328
2026-03-30 11:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e with scrape type 2
2026-03-30 11:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b05f4bf-3759-5498-b72a-8efaf507fc8e with scrape type 2
2026-03-30 11:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2b05f4bf-3759-5498-b72a-8efaf507fc8e, identifier: KH04328
2026-03-30 11:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328
2026-03-30 11:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328
2026-03-30 11:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2b05f4bf-3759-5498-b72a-8efaf507fc8e with identifier: KH04328 to the API
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:16Z',
 'fuel_type': 'diesel',
 'id': '2b05f4bf-3759-5498-b72a-8efaf507fc8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH04328',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 220423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2013}
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-30 11:55:05 [auto1.be] INFO: Saving data for KH04328: {'auction_closing_time': 1774884436.0, 'created_time': 1774697475.504987, 'last_price_update_time': 1774871705.472933}
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH04328') HTTP/1.1" 204 0
2026-03-30 11:55:05 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-30 11:55:05 [auto1.be] INFO: Scrape type for GN32494: 2
2026-03-30 11:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494
2026-03-30 11:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842db12f-e1ec-585c-a241-9fbc250f20de with scrape type 2
2026-03-30 11:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 842db12f-e1ec-585c-a241-9fbc250f20de with scrape type 2
2026-03-30 11:55:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 842db12f-e1ec-585c-a241-9fbc250f20de, identifier: GN32494
2026-03-30 11:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494
2026-03-30 11:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494
2026-03-30 11:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 842db12f-e1ec-585c-a241-9fbc250f20de with identifier: GN32494 to the API
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:17Z',
 'fuel_type': 'diesel',
 'id': '842db12f-e1ec-585c-a241-9fbc250f20de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN32494',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 241084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-10',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-30 11:55:05 [auto1.be] INFO: Saving data for GN32494: {'auction_closing_time': 1774884557.0, 'created_time': 1774697471.88244, 'last_price_update_time': 1774871705.861421}
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN32494') HTTP/1.1" 204 0
2026-03-30 11:55:05 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1771 | hits on page: 40
2026-03-30 11:55:05 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-30 11:55:05 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-30 11:55:05 [auto1.be] INFO: Scrape type for LA84805: 2
2026-03-30 11:55:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805
2026-03-30 11:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f96baf-e76a-579c-9f6e-af39879cc09c with scrape type 2
2026-03-30 11:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39f96baf-e76a-579c-9f6e-af39879cc09c with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39f96baf-e76a-579c-9f6e-af39879cc09c, identifier: LA84805
2026-03-30 11:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805
2026-03-30 11:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805
2026-03-30 11:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39f96baf-e76a-579c-9f6e-af39879cc09c with identifier: LA84805 to the API
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:59:53Z',
 'fuel_type': 'diesel',
 'id': '39f96baf-e76a-579c-9f6e-af39879cc09c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA84805',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 216757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-26',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Kinetic 2WD',
 'transmission': 'automatic',
 'trim': 'Kinetic 2WD',
 'year': 2012}
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Saving data for LA84805: {'auction_closing_time': 1774886393.0, 'created_time': 1774697447.532682, 'last_price_update_time': 1774871706.265677}
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA84805') HTTP/1.1" 204 0
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for RF01360: 2
2026-03-30 11:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360
2026-03-30 11:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d927ef0d-1f06-57f7-8d01-f304e031bd35 with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d927ef0d-1f06-57f7-8d01-f304e031bd35 with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d927ef0d-1f06-57f7-8d01-f304e031bd35, identifier: RF01360
2026-03-30 11:55:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-30 11:55:06 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Scrape type for RX31058: 2
2026-03-30 11:55:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058
2026-03-30 11:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708665a9-0358-5916-ac8f-c4940f6c0658 with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708665a9-0358-5916-ac8f-c4940f6c0658 with scrape type 2
2026-03-30 11:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 708665a9-0358-5916-ac8f-c4940f6c0658, identifier: RX31058
2026-03-30 11:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360
2026-03-30 11:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360
2026-03-30 11:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d927ef0d-1f06-57f7-8d01-f304e031bd35 with identifier: RF01360 to the API
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:10:59Z',
 'fuel_type': 'petrol',
 'id': 'd927ef0d-1f06-57f7-8d01-f304e031bd35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF01360',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 49794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Elite Start/Stop',
 'transmission': 'manual',
 'trim': 'Elite Start/Stop',
 'year': 2019}
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-30 11:55:06 [auto1.be] INFO: Saving data for RF01360: {'auction_closing_time': 1774883459.0, 'created_time': 1774697461.93442, 'last_price_update_time': 1774871706.769094}
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF01360') HTTP/1.1" 204 0
2026-03-30 11:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058
2026-03-30 11:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058
2026-03-30 11:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 708665a9-0358-5916-ac8f-c4940f6c0658 with identifier: RX31058 to the API
2026-03-30 11:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:34:09Z',
 'fuel_type': 'diesel',
 'id': '708665a9-0358-5916-ac8f-c4940f6c0658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX31058',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 144408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-12',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L1H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L1H1 2,9t Expression',
 'year': 2017}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Saving data for RX31058: {'auction_closing_time': 1774884849.0, 'created_time': 1774697461.515532, 'last_price_update_time': 1774871707.187126}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX31058') HTTP/1.1" 204 0
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for UU14069: 2
2026-03-30 11:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069
2026-03-30 11:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a, identifier: UU14069
2026-03-30 11:55:07 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Scrape type for BB55914: 2
2026-03-30 11:55:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914
2026-03-30 11:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55ab384c-2a36-59f4-a817-e36c5a40c743 with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55ab384c-2a36-59f4-a817-e36c5a40c743 with scrape type 2
2026-03-30 11:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55ab384c-2a36-59f4-a817-e36c5a40c743, identifier: BB55914
2026-03-30 11:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069
2026-03-30 11:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069
2026-03-30 11:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ffbf2b1-14dd-5735-8e53-bae43c978d2a with identifier: UU14069 to the API
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:52:16Z',
 'fuel_type': 'diesel',
 'id': '2ffbf2b1-14dd-5735-8e53-bae43c978d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU14069',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 157400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-30 11:55:07 [auto1.be] INFO: Saving data for UU14069: {'auction_closing_time': 1774885936.0, 'created_time': 1774697462.602306, 'last_price_update_time': 1774871707.766728}
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU14069') HTTP/1.1" 204 0
2026-03-30 11:55:07 [scrapy.extensions.logstats] INFO: Crawled 232 pages (at 2 pages/min), scraped 285 items (at 14 items/min)
2026-03-30 11:55:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:55:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914
2026-03-30 11:55:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914
2026-03-30 11:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55ab384c-2a36-59f4-a817-e36c5a40c743 with identifier: BB55914 to the API
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:45:09Z',
 'fuel_type': 'hybrid',
 'id': '55ab384c-2a36-59f4-a817-e36c5a40c743',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB55914',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 47318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-16',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2020}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Saving data for BB55914: {'auction_closing_time': 1774885509.0, 'created_time': 1774697465.521237, 'last_price_update_time': 1774871708.087179}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB55914') HTTP/1.1" 204 0
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Scrape type for XG78459: 2
2026-03-30 11:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-30 11:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99113383-36d9-5392-a76d-12671350da04 with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99113383-36d9-5392-a76d-12671350da04 with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99113383-36d9-5392-a76d-12671350da04, identifier: XG78459
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-30 11:55:08 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Scrape type for KC67497: 2
2026-03-30 11:55:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497
2026-03-30 11:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b42d776-915d-5179-afd8-c2d3d89179cf with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b42d776-915d-5179-afd8-c2d3d89179cf with scrape type 2
2026-03-30 11:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0b42d776-915d-5179-afd8-c2d3d89179cf, identifier: KC67497
2026-03-30 11:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-30 11:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-30 11:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459 to the API
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:25:02Z',
 'fuel_type': 'diesel',
 'id': '99113383-36d9-5392-a76d-12671350da04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG78459',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 217480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Volvo S60 1.6 D2 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2011}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-30 11:55:08 [auto1.be] INFO: Saving data for XG78459: {'auction_closing_time': 1774884302.0, 'created_time': 1774686623.67846, 'last_price_update_time': 1774871708.64678}
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG78459') HTTP/1.1" 204 0
2026-03-30 11:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497
2026-03-30 11:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497
2026-03-30 11:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0b42d776-915d-5179-afd8-c2d3d89179cf with identifier: KC67497 to the API
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:08Z',
 'fuel_type': 'diesel',
 'id': '0b42d776-915d-5179-afd8-c2d3d89179cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC67497',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 158713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Nissan Micra 1.5 dCi N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.be] INFO: Saving data for KC67497: {'auction_closing_time': 1774882868.0, 'created_time': 1774697469.01024, 'last_price_update_time': 1774871709.076164}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC67497') HTTP/1.1" 204 0
2026-03-30 11:55:09 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-30 11:55:09 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.be] INFO: Scrape type for RC25321: 2
2026-03-30 11:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-30 11:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a810397a-27d8-53c7-8d39-8168e3de6697 with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a810397a-27d8-53c7-8d39-8168e3de6697 with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a810397a-27d8-53c7-8d39-8168e3de6697, identifier: RC25321
2026-03-30 11:55:09 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-30 11:55:09 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-30 11:55:09 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-30 11:55:09 [auto1.be] INFO: Found listing with ID: US61346
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.be] INFO: Scrape type for US61346: 2
2026-03-30 11:55:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346
2026-03-30 11:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ad5b7d-f068-51af-b4b4-d8d71d053aff with scrape type 2
2026-03-30 11:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1ad5b7d-f068-51af-b4b4-d8d71d053aff, identifier: US61346
2026-03-30 11:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-30 11:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-30 11:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321 to the API
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:03Z',
 'fuel_type': 'petrol',
 'id': 'a810397a-27d8-53c7-8d39-8168e3de6697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC25321',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 100202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'Toyota Auris 1.2 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2017}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-30 11:55:09 [auto1.be] INFO: Saving data for RC25321: {'auction_closing_time': 1774884543.0, 'created_time': 1774686622.288112, 'last_price_update_time': 1774871709.585929}
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC25321') HTTP/1.1" 204 0
2026-03-30 11:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346
2026-03-30 11:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346
2026-03-30 11:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1ad5b7d-f068-51af-b4b4-d8d71d053aff with identifier: US61346 to the API
2026-03-30 11:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:14:29Z',
 'fuel_type': 'diesel',
 'id': 'a1ad5b7d-f068-51af-b4b4-d8d71d053aff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US61346',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 65876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-02',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.be] INFO: Saving data for US61346: {'auction_closing_time': 1774883669.0, 'created_time': 1774697459.290031, 'last_price_update_time': 1774871710.352644}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='US61346') HTTP/1.1" 204 0
2026-03-30 11:55:10 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.be] INFO: Scrape type for YZ86935: 2
2026-03-30 11:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-30 11:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9c02e-3c22-5592-ba42-87cb997424a2 with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af9c02e-3c22-5592-ba42-87cb997424a2 with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6af9c02e-3c22-5592-ba42-87cb997424a2, identifier: YZ86935
2026-03-30 11:55:10 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.be] INFO: Scrape type for SY12350: 2
2026-03-30 11:55:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350
2026-03-30 11:55:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with scrape type 2
2026-03-30 11:55:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464, identifier: SY12350
2026-03-30 11:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-30 11:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-30 11:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935 to the API
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:40:28Z',
 'fuel_type': 'petrol',
 'id': '6af9c02e-3c22-5592-ba42-87cb997424a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ86935',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 219581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.8 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2012}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-30 11:55:10 [auto1.be] INFO: Saving data for YZ86935: {'auction_closing_time': 1774885228.0, 'created_time': 1774686632.447211, 'last_price_update_time': 1774871710.866222}
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ86935') HTTP/1.1" 204 0
2026-03-30 11:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350
2026-03-30 11:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350
2026-03-30 11:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8b7998c-6bb7-5fb8-8c35-c4cae65a6464 with identifier: SY12350 to the API
2026-03-30 11:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'diesel',
 'id': 'd8b7998c-6bb7-5fb8-8c35-c4cae65a6464',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY12350',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 171187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-18',
 'seller_name': None,
 'title': 'Opel Combo 1.3 CDTI Selection L1H1',
 'transmission': 'manual',
 'trim': 'Selection L1H1',
 'year': 2016}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.be] INFO: Saving data for SY12350: {'auction_closing_time': 1774885735.0, 'created_time': 1773349212.952081, 'last_price_update_time': 1774871711.166049}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY12350') HTTP/1.1" 204 0
2026-03-30 11:55:11 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.be] INFO: Scrape type for XB72565: 2
2026-03-30 11:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-30 11:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939a141-7d36-5e5c-8878-99839cc8c1aa with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b939a141-7d36-5e5c-8878-99839cc8c1aa with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b939a141-7d36-5e5c-8878-99839cc8c1aa, identifier: XB72565
2026-03-30 11:55:11 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.be] INFO: Scrape type for ST29091: 2
2026-03-30 11:55:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091
2026-03-30 11:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b72da8e-378d-5b38-bbba-a33071818563 with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b72da8e-378d-5b38-bbba-a33071818563 with scrape type 2
2026-03-30 11:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b72da8e-378d-5b38-bbba-a33071818563, identifier: ST29091
2026-03-30 11:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-30 11:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-30 11:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565 to the API
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:31Z',
 'fuel_type': 'petrol',
 'id': 'b939a141-7d36-5e5c-8878-99839cc8c1aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB72565',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 173649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Fiat Punto 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.be] INFO: Saving data for XB72565: {'auction_closing_time': 1774885651.0, 'created_time': 1774686633.738949, 'last_price_update_time': 1774871711.693865}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB72565') HTTP/1.1" 204 0
2026-03-30 11:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091
2026-03-30 11:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091
2026-03-30 11:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b72da8e-378d-5b38-bbba-a33071818563 with identifier: ST29091 to the API
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:12Z',
 'fuel_type': 'diesel',
 'id': '5b72da8e-378d-5b38-bbba-a33071818563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST29091',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 146362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi Monaco GP',
 'transmission': 'manual',
 'trim': 'Monaco GP',
 'year': 2012}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-30 11:55:11 [auto1.be] INFO: Saving data for ST29091: {'auction_closing_time': 1774884072.0, 'created_time': 1774697467.412167, 'last_price_update_time': 1774871711.985583}
2026-03-30 11:55:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST29091') HTTP/1.1" 204 0
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.be] INFO: Scrape type for PV46198: 2
2026-03-30 11:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-30 11:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0, identifier: PV46198
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.be] INFO: Scrape type for TV57254: 2
2026-03-30 11:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254
2026-03-30 11:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75, identifier: TV57254
2026-03-30 11:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-30 11:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-30 11:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198 to the API
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:04Z',
 'fuel_type': 'diesel',
 'id': '90f40c8e-c4c4-5a97-bf2c-b01e97743af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV46198',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 177585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC AMG Line',
 'transmission': 'manual',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.be] INFO: Saving data for PV46198: {'auction_closing_time': 1774884964.0, 'created_time': 1774686636.101409, 'last_price_update_time': 1774871712.497663}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV46198') HTTP/1.1" 204 0
2026-03-30 11:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254
2026-03-30 11:55:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254
2026-03-30 11:55:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c34719b-6f0b-5dce-9c50-d8ca13e51f75 with identifier: TV57254 to the API
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:57Z',
 'fuel_type': 'diesel',
 'id': '1c34719b-6f0b-5dce-9c50-d8ca13e51f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV57254',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 141137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-09',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2012}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.be] INFO: Saving data for TV57254: {'auction_closing_time': 1774886217.0, 'created_time': 1774697477.885361, 'last_price_update_time': 1774871712.909454}
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV57254') HTTP/1.1" 204 0
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-30 11:55:12 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-30 11:55:12 [auto1.be] INFO: Scrape type for RU30240: 2
2026-03-30 11:55:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-30 11:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with scrape type 2
2026-03-30 11:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with scrape type 2
2026-03-30 11:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a, identifier: RU30240
2026-03-30 11:55:13 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-30 11:55:13 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-30 11:55:13 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-30 11:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-30 11:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-30 11:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240 to the API
2026-03-30 11:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:15:26Z',
 'fuel_type': 'diesel',
 'id': 'f6ff7c35-d015-5ddc-9dc9-c05307fdb49a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU30240',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 258528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 HSE',
 'transmission': 'automatic',
 'trim': 'TDV6 HSE',
 'year': 2013}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.be] INFO: Saving data for RU30240: {'auction_closing_time': 1774883726.0, 'created_time': 1774038909.415172, 'last_price_update_time': 1774871714.167582}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU30240') HTTP/1.1" 204 0
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.be] INFO: Scrape type for XX22473: 2
2026-03-30 11:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-30 11:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2637847d-d04e-5098-93ad-f77b7b465c28 with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2637847d-d04e-5098-93ad-f77b7b465c28 with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2637847d-d04e-5098-93ad-f77b7b465c28, identifier: XX22473
2026-03-30 11:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-30 11:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-30 11:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473 to the API
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:16Z',
 'fuel_type': 'diesel',
 'id': '2637847d-d04e-5098-93ad-f77b7b465c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX22473',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 121488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'BMW 5er 520d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.be] INFO: Saving data for XX22473: {'auction_closing_time': 1774883896.0, 'created_time': 1774686626.272066, 'last_price_update_time': 1774871714.571164}
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XX22473') HTTP/1.1" 204 0
2026-03-30 11:55:14 [auto1.be] INFO: Channel: 24h | Page: 45 | totalHits: 1772 | hits on page: 12
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-30 11:55:14 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-30 11:55:14 [auto1.be] INFO: Scrape type for YA99172: 2
2026-03-30 11:55:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-30 11:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 with scrape type 2
2026-03-30 11:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bda98b99-4937-5a42-8e63-c32c9fb7bce0, identifier: YA99172
2026-03-30 11:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-30 11:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-30 11:55:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172 to the API
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:33Z',
 'fuel_type': 'petrol',
 'id': 'bda98b99-4937-5a42-8e63-c32c9fb7bce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA99172',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 85500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2017}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.be] INFO: Saving data for YA99172: {'auction_closing_time': 1774884453.0, 'created_time': 1774686637.005285, 'last_price_update_time': 1774871715.06887}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA99172') HTTP/1.1" 204 0
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.be] INFO: Scrape type for PV20794: 2
2026-03-30 11:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-30 11:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5abfb09-096f-532b-9564-a74a71f4eb23 with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5abfb09-096f-532b-9564-a74a71f4eb23 with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5abfb09-096f-532b-9564-a74a71f4eb23, identifier: PV20794
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.be] INFO: Scrape type for PD03709: 2
2026-03-30 11:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-30 11:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ce2412-ea07-572e-a344-4d0ddcad51ab with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38ce2412-ea07-572e-a344-4d0ddcad51ab with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 38ce2412-ea07-572e-a344-4d0ddcad51ab, identifier: PD03709
2026-03-30 11:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-30 11:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-30 11:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794 to the API
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:03Z',
 'fuel_type': 'diesel',
 'id': 'f5abfb09-096f-532b-9564-a74a71f4eb23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV20794',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 179167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-03',
 'seller_name': None,
 'title': 'BMW 1er 116d Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2018}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.be] INFO: Saving data for PV20794: {'auction_closing_time': 1774883643.0, 'created_time': 1773952983.201175, 'last_price_update_time': 1774871715.580192}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV20794') HTTP/1.1" 204 0
2026-03-30 11:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-30 11:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-30 11:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709 to the API
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'diesel',
 'id': '38ce2412-ea07-572e-a344-4d0ddcad51ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD03709',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 144505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.be] INFO: Saving data for PD03709: {'auction_closing_time': 1774885470.0, 'created_time': 1774686628.956482, 'last_price_update_time': 1774871715.874859}
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD03709') HTTP/1.1" 204 0
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-30 11:55:15 [auto1.be] INFO: Scrape type for SJ57770: 2
2026-03-30 11:55:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-30 11:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with scrape type 2
2026-03-30 11:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1, identifier: SJ57770
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-30 11:55:15 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.be] INFO: Scrape type for HJ47401: 2
2026-03-30 11:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-30 11:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de368a48-e901-5fdc-a5dc-188545f22020 with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de368a48-e901-5fdc-a5dc-188545f22020 with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de368a48-e901-5fdc-a5dc-188545f22020, identifier: HJ47401
2026-03-30 11:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-30 11:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-30 11:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770 to the API
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:11:14Z',
 'fuel_type': 'diesel',
 'id': '6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ57770',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 86756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Inform 2WD',
 'transmission': 'manual',
 'trim': 'Inform 2WD',
 'year': 2011}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.be] INFO: Saving data for SJ57770: {'auction_closing_time': 1774883474.0, 'created_time': 1774686627.159066, 'last_price_update_time': 1774871716.422084}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ57770') HTTP/1.1" 204 0
2026-03-30 11:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-30 11:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-30 11:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401 to the API
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'diesel',
 'id': 'de368a48-e901-5fdc-a5dc-188545f22020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ47401',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 170839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.be] INFO: Saving data for HJ47401: {'auction_closing_time': 1774884104.0, 'created_time': 1774002050.444121, 'last_price_update_time': 1774871716.831193}
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ47401') HTTP/1.1" 204 0
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-30 11:55:16 [auto1.be] INFO: Scrape type for UW48636: 2
2026-03-30 11:55:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636
2026-03-30 11:55:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with scrape type 2
2026-03-30 11:55:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9, identifier: UW48636
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-30 11:55:16 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.be] INFO: Scrape type for WY04920: 2
2026-03-30 11:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-30 11:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d41633-c89c-5c81-8d05-452ae275da35 with scrape type 2
2026-03-30 11:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d41633-c89c-5c81-8d05-452ae275da35 with scrape type 2
2026-03-30 11:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34d41633-c89c-5c81-8d05-452ae275da35, identifier: WY04920
2026-03-30 11:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636
2026-03-30 11:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636
2026-03-30 11:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7852e0b3-eec8-5486-b88c-ebf6b08d12e9 with identifier: UW48636 to the API
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:32:44Z',
 'fuel_type': 'diesel',
 'id': '7852e0b3-eec8-5486-b88c-ebf6b08d12e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW48636',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 85399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.be] INFO: Saving data for UW48636: {'auction_closing_time': 1774884764.0, 'created_time': 1774513852.024721, 'last_price_update_time': 1774871717.381016}
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UW48636') HTTP/1.1" 204 0
2026-03-30 11:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-30 11:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-30 11:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920 to the API
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:19:47Z',
 'fuel_type': 'petrol',
 'id': '34d41633-c89c-5c81-8d05-452ae275da35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY04920',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 106400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.be] INFO: Saving data for WY04920: {'auction_closing_time': 1774883987.0, 'created_time': 1774686624.466636, 'last_price_update_time': 1774871717.686707}
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WY04920') HTTP/1.1" 204 0
2026-03-30 11:55:17 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.be] INFO: Scrape type for PG64643: 2
2026-03-30 11:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643
2026-03-30 11:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14146459-2f14-56b5-a83d-8f42138ad58a with scrape type 2
2026-03-30 11:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14146459-2f14-56b5-a83d-8f42138ad58a with scrape type 2
2026-03-30 11:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14146459-2f14-56b5-a83d-8f42138ad58a, identifier: PG64643
2026-03-30 11:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643
2026-03-30 11:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643
2026-03-30 11:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14146459-2f14-56b5-a83d-8f42138ad58a with identifier: PG64643 to the API
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:51Z',
 'fuel_type': 'diesel',
 'id': '14146459-2f14-56b5-a83d-8f42138ad58a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG64643',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 120225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 Blue dCi Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2019}
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-30 11:55:18 [auto1.be] INFO: Saving data for PG64643: {'auction_closing_time': 1774886211.0, 'created_time': 1774513850.595762, 'last_price_update_time': 1774871718.116679}
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PG64643') HTTP/1.1" 204 0
2026-03-30 11:55:18 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 11:56:07 [scrapy.extensions.logstats] INFO: Crawled 233 pages (at 1 pages/min), scraped 306 items (at 21 items/min)
2026-03-30 11:56:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 11:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:29 [auto1.be] INFO: Channel: 24h | Page: 46 | totalHits: 1774 | hits on page: 0
2026-03-30 11:56:29 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 11:56:29 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-30 11:56:29 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-30 11:56:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774439789 HTTP/1.1" 200 None
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AP84520') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AR36497') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AU41083') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BB39681') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BD40463') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BD53384') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BH68776') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BT92809') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BV06503') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ10873') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ95713') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CJ73032') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CM24816') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CP04186') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CT55642') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CV21879') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DC14149') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DE46639') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DK93397') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DL26688') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DN87160') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DP85485') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EE08329') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EF51410') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EL04260') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EX82967') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ05749') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FW24983') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GE59758') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GL61744') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GL67153') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GP56655') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GW67929') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GX95558') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HF47141') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HH48573') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HM33931') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HY33181') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ33316') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JD30271') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JN06463') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JS95214') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JY81658') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KH36222') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KN42152') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KX39091') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LE53501') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LG22309') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LN60364') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LU00457') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ43010') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MB77456') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MF49790') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MV72400') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MX60817') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MY99470') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NC29660') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NF29238') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NM37216') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NN05116') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NN31661') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NP43182') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NS79292') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PC97133') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PD72262') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PP77411') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ51586') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RR09297') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RS78198') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SK88773') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SL69590') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SR87470') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SY57836') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TB99093') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TC54152') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TD32383') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TD56666') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TG12006') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TV67376') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UE34911') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UG70927') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VF73063') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VN29155') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP36838') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VP45357') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WH29067') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WN13897') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WP80127') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WR87595') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XC53654') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ46329') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XL06908') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XN58285') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XS32850') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XS83514') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YK75126') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YU69555') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YW66689') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YY23738') HTTP/1.1" 204 0
2026-03-30 11:56:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZB20950') HTTP/1.1" 204 0
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK75429') HTTP/1.1" 204 0
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL16180') HTTP/1.1" 204 0
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS66256') HTTP/1.1" 204 0
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY17485') HTTP/1.1" 204 0
2026-03-30 11:56:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY75611') HTTP/1.1" 204 0
2026-03-30 11:56:31 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (306 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-30T11_30_00.jl
2026-03-30 11:56:31 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1550994,
 'downloader/request_count': 886,
 'downloader/request_method_count/GET': 838,
 'downloader/request_method_count/POST': 48,
 'downloader/response_bytes': 253024266,
 'downloader/response_count': 886,
 'downloader/response_status_count/200': 886,
 'dupefilter/filtered': 15,
 'elapsed_time_seconds': 1583.868565,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 11, 56, 31, 40779, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 306,
 'log_count/DEBUG': 9881,
 'log_count/INFO': 10230,
 'memusage/max': 193638400,
 'memusage/startup': 150036480,
 'photo_download_count': 652,
 'request_depth_max': 49,
 'response_received_count': 234,
 'scheduler/dequeued': 886,
 'scheduler/dequeued/memory': 886,
 'scheduler/enqueued': 886,
 'scheduler/enqueued/memory': 886,
 'scrape_type/batch_skipped': 911,
 'scrape_type/new': 92,
 'scrape_type/price_update': 214,
 'scrape_type/skipped': 580,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 262,
 'scrapy-zyte-api/error_ratio': 0.10687022900763359,
 'scrapy-zyte-api/errors': 28,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 28,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 11.99176916868712,
 'scrapy-zyte-api/mean_response_seconds': 12.0347442750831,
 'scrapy-zyte-api/processed': 234,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 234,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 233,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 234,
 'scrapy-zyte-api/request_args/httpRequestBody': 48,
 'scrapy-zyte-api/request_args/httpRequestMethod': 48,
 'scrapy-zyte-api/request_args/httpResponseBody': 234,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 234,
 'scrapy-zyte-api/request_args/sessionContext': 234,
 'scrapy-zyte-api/request_args/url': 234,
 'scrapy-zyte-api/status_codes/0': 28,
 'scrapy-zyte-api/status_codes/200': 234,
 'scrapy-zyte-api/success': 234,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1812,
 'source/total_available': 1774,
 'start_time': datetime.datetime(2026, 3, 30, 11, 30, 7, 172214, tzinfo=datetime.timezone.utc)}
2026-03-30 11:56:31 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 11:56:31 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe7ebfaefd0>
2026-03-30 11:56:31 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe7ec036450>