2026-03-27 11:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 11:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 11:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-27 11:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-27 11:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 11:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 11:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 11:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 11:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: ccf3e178399f3d30
2026-03-27 11:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 11:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-27T11_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 11:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 11:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 11:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 11:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 11:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 11:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 11:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 11:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 11:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 11:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 11:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 11:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 11:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-27 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 11:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 11:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 11:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 11:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 11:35:15 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1870 | hits on page: 40
2026-03-27 11:35:15 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-27 11:35:15 [auto1.be] INFO: Scrape type for BB40778: 1
2026-03-27 11:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:15 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-27 11:35:15 [auto1.be] INFO: Scrape type for VM57702: 1
2026-03-27 11:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:15 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-27 11:35:15 [auto1.be] INFO: Scrape type for YV36261: 2
2026-03-27 11:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-27 11:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bbead9-acb7-5c85-b22c-dbea4f404194 with scrape type 2
2026-03-27 11:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bbead9-acb7-5c85-b22c-dbea4f404194 with scrape type 2
2026-03-27 11:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2bbead9-acb7-5c85-b22c-dbea4f404194, identifier: YV36261
2026-03-27 11:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 11:35:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261
2026-03-27 11:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2bbead9-acb7-5c85-b22c-dbea4f404194 with identifier: YV36261 to the API
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:42:41Z',
 'fuel_type': 'petrol',
 'id': 'b2bbead9-acb7-5c85-b22c-dbea4f404194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV36261',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 195767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2013}
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Saving data for YV36261: {'auction_closing_time': 1774716161.0, 'created_time': 1773866134.068108, 'last_price_update_time': 1774611316.390354}
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV36261') HTTP/1.1" 204 0
2026-03-27 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for WG23357: 1
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for RC34183: 1
2026-03-27 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for VZ41655: 1
2026-03-27 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: SA18446
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for NM33768: 1
2026-03-27 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for TY10971: 1
2026-03-27 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for BU27000: 1
2026-03-27 11:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for MP28046: 1
2026-03-27 11:35:16 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-27 11:35:16 [auto1.be] INFO: Scrape type for SL51907: 2
2026-03-27 11:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-27 11:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094d12aa-415e-5ad0-b27b-d52674877643 with scrape type 2
2026-03-27 11:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 094d12aa-415e-5ad0-b27b-d52674877643 with scrape type 2
2026-03-27 11:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 094d12aa-415e-5ad0-b27b-d52674877643, identifier: SL51907
2026-03-27 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907
2026-03-27 11:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 094d12aa-415e-5ad0-b27b-d52674877643 with identifier: SL51907 to the API
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:09:16Z',
 'fuel_type': 'diesel',
 'id': '094d12aa-415e-5ad0-b27b-d52674877643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL51907',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 202104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-27 11:35:17 [auto1.be] INFO: Saving data for SL51907: {'auction_closing_time': 1774714156.0, 'created_time': 1773866476.957817, 'last_price_update_time': 1774611317.233266}
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL51907') HTTP/1.1" 204 0
2026-03-27 11:35:17 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-27 11:35:17 [auto1.be] INFO: Scrape type for LE04651: 1
2026-03-27 11:35:17 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-27 11:35:17 [auto1.be] INFO: Scrape type for DL37030: 2
2026-03-27 11:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030
2026-03-27 11:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35de0836-6b7d-5752-ae3e-84f777b803c9 with scrape type 2
2026-03-27 11:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35de0836-6b7d-5752-ae3e-84f777b803c9 with scrape type 2
2026-03-27 11:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35de0836-6b7d-5752-ae3e-84f777b803c9, identifier: DL37030
2026-03-27 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030
2026-03-27 11:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35de0836-6b7d-5752-ae3e-84f777b803c9 with identifier: DL37030 to the API
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:50:43Z',
 'fuel_type': 'petrol',
 'id': '35de0836-6b7d-5752-ae3e-84f777b803c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL37030',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 10976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-20',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-27 11:35:17 [auto1.be] INFO: Saving data for DL37030: {'auction_closing_time': 1774716643.0, 'created_time': 1773909326.149795, 'last_price_update_time': 1774611317.883533}
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL37030') HTTP/1.1" 204 0
2026-03-27 11:35:17 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-27 11:35:17 [auto1.be] INFO: Scrape type for ZL15279: 2
2026-03-27 11:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-27 11:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with scrape type 2
2026-03-27 11:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with scrape type 2
2026-03-27 11:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d, identifier: ZL15279
2026-03-27 11:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-27 11:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279
2026-03-27 11:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ab0c8d4c-afc1-593f-bba2-4af7d0e2812d with identifier: ZL15279 to the API
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:49:06Z',
 'fuel_type': 'diesel',
 'id': 'ab0c8d4c-afc1-593f-bba2-4af7d0e2812d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL15279',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 242853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-27 11:35:18 [auto1.be] INFO: Saving data for ZL15279: {'auction_closing_time': 1774716546.0, 'created_time': 1773909333.908026, 'last_price_update_time': 1774611318.334456}
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL15279') HTTP/1.1" 204 0
2026-03-27 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM57702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-27 11:35:18 [auto1.be] INFO: Scrape type for NB03494: 2
2026-03-27 11:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-27 11:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ab4edf-e363-585d-904a-7f498841c1d9 with scrape type 2
2026-03-27 11:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ab4edf-e363-585d-904a-7f498841c1d9 with scrape type 2
2026-03-27 11:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0ab4edf-e363-585d-904a-7f498841c1d9, identifier: NB03494
2026-03-27 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 11:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494
2026-03-27 11:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0ab4edf-e363-585d-904a-7f498841c1d9 with identifier: NB03494 to the API
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:56:06Z',
 'fuel_type': 'petrol',
 'id': 'c0ab4edf-e363-585d-904a-7f498841c1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB03494',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 40166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-27 11:35:18 [auto1.be] INFO: Saving data for NB03494: {'auction_closing_time': 1774716966.0, 'created_time': 1773693675.093387, 'last_price_update_time': 1774611318.907329}
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB03494') HTTP/1.1" 204 0
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-27 11:35:18 [auto1.be] INFO: Scrape type for TS47815: 1
2026-03-27 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB40778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-27 11:35:18 [auto1.be] INFO: Scrape type for DE21401: 1
2026-03-27 11:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG23357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-27 11:35:18 [auto1.be] INFO: Scrape type for YH09444: 1
2026-03-27 11:35:18 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-27 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY10971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:19 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1870 | hits on page: 40
2026-03-27 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM33768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-27 11:35:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/BB40778/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-27 11:35:19 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: SA18446
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-27 11:35:19 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL37030%27 HTTP/1.1" 200 None
2026-03-27 11:35:19 [auto1.be] INFO: Scrape type for DL37030: 0
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-27 11:35:19 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-27 11:35:19 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-27 11:35:19 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-27 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ41655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC34183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE21401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS47815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE04651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM57702> (referer: https://www.auto1.com/v1/car-details-view/VM57702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU27000/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-27 11:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with scrape type 1
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_a80dcd23d9dab47e9f62b640187f5943.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_a80dcd23d9dab47e9f62b640187f5943.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_ca3cc5e5e8f78bb334d304cf8871475f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_ca3cc5e5e8f78bb334d304cf8871475f.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_9fc59dae45b997064d375a34ca19bea7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_9fc59dae45b997064d375a34ca19bea7.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_19e1c0efc73fa42b9023ff9f3f0cff0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_19e1c0efc73fa42b9023ff9f3f0cff0f.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_9fd2ae4c37ebfefeb4ae81907b095a8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_9fd2ae4c37ebfefeb4ae81907b095a8d.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_8c76646e9a8b1c7707d410b0b1c02d4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_8c76646e9a8b1c7707d410b0b1c02d4c.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_2d49157ac25ca530ab904a84ccd2f22d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_2d49157ac25ca530ab904a84ccd2f22d.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_a7f5f69f8d3805ccff2a1d63dfc36694.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_a7f5f69f8d3805ccff2a1d63dfc36694.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_ec528e1fbe7b4f696c2200222edfb21b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_ec528e1fbe7b4f696c2200222edfb21b.jpg already downloaded
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F24%252F81248264c13996c8bc6e81b09cc12545%252Fpa%252FVM57702_76b1ca2a4e8055ab4834c8ef3d221167.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_76b1ca2a4e8055ab4834c8ef3d221167.jpg already downloaded
2026-03-27 11:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5, identifier: VM57702
2026-03-27 11:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-27 11:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702
2026-03-27 11:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6380588a-75da-5a3b-8dbe-d2c83a6ea6b5 with identifier: VM57702 to the API
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM57702>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:37:19Z',
 'fuel_type': 'diesel',
 'id': '6380588a-75da-5a3b-8dbe-d2c83a6ea6b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM57702',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 289125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_a80dcd23d9dab47e9f62b640187f5943.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_ca3cc5e5e8f78bb334d304cf8871475f.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_9fc59dae45b997064d375a34ca19bea7.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_19e1c0efc73fa42b9023ff9f3f0cff0f.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_9fd2ae4c37ebfefeb4ae81907b095a8d.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_8c76646e9a8b1c7707d410b0b1c02d4c.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_2d49157ac25ca530ab904a84ccd2f22d.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_a7f5f69f8d3805ccff2a1d63dfc36694.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_ec528e1fbe7b4f696c2200222edfb21b.jpg',
                'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_76b1ca2a4e8055ab4834c8ef3d221167.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_a80dcd23d9dab47e9f62b640187f5943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_ca3cc5e5e8f78bb334d304cf8871475f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_9fc59dae45b997064d375a34ca19bea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_19e1c0efc73fa42b9023ff9f3f0cff0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_9fd2ae4c37ebfefeb4ae81907b095a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_8c76646e9a8b1c7707d410b0b1c02d4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_2d49157ac25ca530ab904a84ccd2f22d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_a7f5f69f8d3805ccff2a1d63dfc36694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_ec528e1fbe7b4f696c2200222edfb21b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6380588a-75da-5a3b-8dbe-d2c83a6ea6b5/6380588a-75da-5a3b-8dbe-d2c83a6ea6b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/24/81248264c13996c8bc6e81b09cc12545/pa/VM57702_76b1ca2a4e8055ab4834c8ef3d221167.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2018}
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-27 11:35:20 [auto1.be] INFO: Saving data for VM57702: {'created_time': 1774611320.76343, 'last_price_update_time': 1774611320.763444, 'auction_closing_time': 1774715839.0}
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM57702') HTTP/1.1" 204 0
2026-03-27 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH09444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB40778> (referer: https://www.auto1.com/v1/car-details-view/BB40778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:21 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1870 | hits on page: 40
2026-03-27 11:35:21 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-27 11:35:21 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-27 11:35:21 [auto1.be] INFO: Scrape type for BU79691: 1
2026-03-27 11:35:21 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-27 11:35:21 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-27 11:35:21 [auto1.be] INFO: Scrape type for CP42003: 2
2026-03-27 11:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-27 11:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b225942-8429-5d44-a314-122de3d7692b with scrape type 2
2026-03-27 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b225942-8429-5d44-a314-122de3d7692b with scrape type 2
2026-03-27 11:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b225942-8429-5d44-a314-122de3d7692b, identifier: CP42003
2026-03-27 11:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-27 11:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with scrape type 1
2026-03-27 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_2e7939996c97b384c313fba1c407f4b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_2e7939996c97b384c313fba1c407f4b5.jpg not downloaded yet
2026-03-27 11:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-27 11:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003
2026-03-27 11:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b225942-8429-5d44-a314-122de3d7692b with identifier: CP42003 to the API
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:23:15Z',
 'fuel_type': 'petrol',
 'id': '6b225942-8429-5d44-a314-122de3d7692b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP42003',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 208306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2018}
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-27 11:35:21 [auto1.be] INFO: Saving data for CP42003: {'auction_closing_time': 1774714995.0, 'created_time': 1773224388.316616, 'last_price_update_time': 1774611321.572807}
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP42003') HTTP/1.1" 204 0
2026-03-27 11:35:21 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-27 11:35:21 [auto1.be] INFO: Scrape type for LY80968: 2
2026-03-27 11:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-27 11:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with scrape type 2
2026-03-27 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with scrape type 2
2026-03-27 11:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea6776dc-8dfa-5974-bfab-c120f1cc51b9, identifier: LY80968
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_334d4d08b4f1c9cdecd789afa5efd3eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_334d4d08b4f1c9cdecd789afa5efd3eb.jpg not downloaded yet
2026-03-27 11:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 11:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968
2026-03-27 11:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea6776dc-8dfa-5974-bfab-c120f1cc51b9 with identifier: LY80968 to the API
2026-03-27 11:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:35Z',
 'fuel_type': 'petrol',
 'id': 'ea6776dc-8dfa-5974-bfab-c120f1cc51b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY80968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 57491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Saving data for LY80968: {'auction_closing_time': 1774714715.0, 'created_time': 1773477347.71579, 'last_price_update_time': 1774611322.141066}
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY80968') HTTP/1.1" 204 0
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Scrape type for WP77061: 2
2026-03-27 11:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-27 11:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a147e50-aa18-5959-b2b8-28fea0ad92ba with scrape type 2
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a147e50-aa18-5959-b2b8-28fea0ad92ba with scrape type 2
2026-03-27 11:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a147e50-aa18-5959-b2b8-28fea0ad92ba, identifier: WP77061
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_96ee2683c000fd257455f47aeb71824c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_96ee2683c000fd257455f47aeb71824c.jpg not downloaded yet
2026-03-27 11:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-27 11:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061
2026-03-27 11:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a147e50-aa18-5959-b2b8-28fea0ad92ba with identifier: WP77061 to the API
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:42:03Z',
 'fuel_type': 'petrol',
 'id': '8a147e50-aa18-5959-b2b8-28fea0ad92ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP77061',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 108707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-04',
 'seller_name': None,
 'title': 'Maserati Levante 2.0 Turbo Mild-Hybrid GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Saving data for WP77061: {'auction_closing_time': 1774716123.0, 'created_time': 1773747445.557384, 'last_price_update_time': 1774611322.590822}
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP77061') HTTP/1.1" 204 0
2026-03-27 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY10971> (referer: https://www.auto1.com/v1/car-details-view/TY10971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG23357> (referer: https://www.auto1.com/v1/car-details-view/WG23357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Scrape type for TU68669: 1
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_9cf272396fd80d90b4e9ef902fbac2a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_9cf272396fd80d90b4e9ef902fbac2a6.jpg not downloaded yet
2026-03-27 11:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Scrape type for JM34078: 1
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_ec6290d67e6182e5a5987b90c14df0da.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_ec6290d67e6182e5a5987b90c14df0da.jpg not downloaded yet
2026-03-27 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ41655> (referer: https://www.auto1.com/v1/car-details-view/VZ41655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM33768> (referer: https://www.auto1.com/v1/car-details-view/NM33768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Scrape type for RK79502: 1
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_182e4677545b2f8330d212b632acac4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_182e4677545b2f8330d212b632acac4c.jpg not downloaded yet
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Scrape type for EN18719: 1
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-27 11:35:22 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [auto1.be] INFO: Scrape type for NP69529: 1
2026-03-27 11:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971
2026-03-27 11:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with scrape type 1
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_81acdae30b022e3ef404c4e4933515e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_81acdae30b022e3ef404c4e4933515e1.jpg not downloaded yet
2026-03-27 11:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-27 11:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06598ae-29da-5344-879a-d1331dcc094f with scrape type 1
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c06598ae-29da-5344-879a-d1331dcc094f
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_37ab4afea4c14ede8b773a1e15ec4705.png%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_37ab4afea4c14ede8b773a1e15ec4705.png already downloaded
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_75af23d381de084b757ddb9b99a43fee.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_75af23d381de084b757ddb9b99a43fee.jpg already downloaded
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_cd1b23ba558a4388360d30cf07698991.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_cd1b23ba558a4388360d30cf07698991.jpg already downloaded
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_bdf2f469a35ff30ab226c0b3e07d3803.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_bdf2f469a35ff30ab226c0b3e07d3803.jpg already downloaded
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_0b9b57f23ddf65a082134f1d8fe30b3b.png%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_0b9b57f23ddf65a082134f1d8fe30b3b.png already downloaded
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_32abd45213ba968a14adf79e7263e673.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_32abd45213ba968a14adf79e7263e673.jpg already downloaded
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_6e9af609106da7cf1cf8c498970e529d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_6e9af609106da7cf1cf8c498970e529d.jpg already downloaded
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_314735c9797d42a4884189e33ef5f65c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_314735c9797d42a4884189e33ef5f65c.jpg already downloaded
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_d0dcc3944386f7b3440af6efb193cb6c.png%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_d0dcc3944386f7b3440af6efb193cb6c.png already downloaded
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Ff7%252F3af7f1491d8197d115513abd05cce9eb%252Fpa%252FWG23357_2d0fa820da5affd3cc7379469e8d8834.png%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_2d0fa820da5affd3cc7379469e8d8834.png already downloaded
2026-03-27 11:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c06598ae-29da-5344-879a-d1331dcc094f, identifier: WG23357
2026-03-27 11:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-27 11:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357
2026-03-27 11:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c06598ae-29da-5344-879a-d1331dcc094f with identifier: WG23357 to the API
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG23357>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:55:26Z',
 'fuel_type': 'petrol',
 'id': 'c06598ae-29da-5344-879a-d1331dcc094f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG23357',
 'listing': 'auction',
 'location': 'BE, Tienen',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 11155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 19,
 'photo_urls': ['https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_37ab4afea4c14ede8b773a1e15ec4705.png',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_75af23d381de084b757ddb9b99a43fee.jpg',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_cd1b23ba558a4388360d30cf07698991.jpg',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_bdf2f469a35ff30ab226c0b3e07d3803.jpg',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_0b9b57f23ddf65a082134f1d8fe30b3b.png',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_32abd45213ba968a14adf79e7263e673.jpg',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_6e9af609106da7cf1cf8c498970e529d.jpg',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_314735c9797d42a4884189e33ef5f65c.jpg',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_d0dcc3944386f7b3440af6efb193cb6c.png',
                'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_2d0fa820da5affd3cc7379469e8d8834.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 448358,
             'Height': 576,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_37ab4afea4c14ede8b773a1e15ec4705.png',
             'Width': 777},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_75af23d381de084b757ddb9b99a43fee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_cd1b23ba558a4388360d30cf07698991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_bdf2f469a35ff30ab226c0b3e07d3803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 452185,
             'Height': 577,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_0b9b57f23ddf65a082134f1d8fe30b3b.png',
             'Width': 777},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_32abd45213ba968a14adf79e7263e673.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_6e9af609106da7cf1cf8c498970e529d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_314735c9797d42a4884189e33ef5f65c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_8.png',
             'Extension': 'png',
             'FileSizeInBytes': 632235,
             'Height': 584,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_d0dcc3944386f7b3440af6efb193cb6c.png',
             'Width': 785},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06598ae-29da-5344-879a-d1331dcc094f/c06598ae-29da-5344-879a-d1331dcc094f_image_9.png',
             'Extension': 'png',
             'FileSizeInBytes': 644710,
             'Height': 581,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/f7/3af7f1491d8197d115513abd05cce9eb/pa/WG23357_2d0fa820da5affd3cc7379469e8d8834.png',
             'Width': 774}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 Mild-Hybrid Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [auto1.be] INFO: Saving data for WG23357: {'created_time': 1774611323.485967, 'last_price_update_time': 1774611323.485982, 'auction_closing_time': 1774716926.0}
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG23357') HTTP/1.1" 204 0
2026-03-27 11:35:23 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-27 11:35:23 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [auto1.be] INFO: Scrape type for GH45635: 2
2026-03-27 11:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-27 11:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with scrape type 2
2026-03-27 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with scrape type 2
2026-03-27 11:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37, identifier: GH45635
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_327e97bdaa98597e72e7d9ddd158ca63.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_327e97bdaa98597e72e7d9ddd158ca63.jpg not downloaded yet
2026-03-27 11:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 11:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635
2026-03-27 11:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23257b69-fb1f-5cc3-8d02-79f3bcb2fc37 with identifier: GH45635 to the API
2026-03-27 11:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-28T16:09:51Z',
 'fuel_type': 'hybrid',
 'id': '23257b69-fb1f-5cc3-8d02-79f3bcb2fc37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH45635',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 206000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [auto1.be] INFO: Saving data for GH45635: {'auction_closing_time': 1774714191.0, 'created_time': 1773301934.312303, 'last_price_update_time': 1774611324.259462}
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH45635') HTTP/1.1" 204 0
2026-03-27 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655
2026-03-27 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with scrape type 1
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_80e0128405966b0c8ca88539bbae4bf4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_80e0128405966b0c8ca88539bbae4bf4.jpg not downloaded yet
2026-03-27 11:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-27 11:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78516ba2-6b22-5a5b-a721-9293f0a07342 with scrape type 1
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78516ba2-6b22-5a5b-a721-9293f0a07342
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_e850003bc7640f064cf6e58e7a7f57a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_e850003bc7640f064cf6e58e7a7f57a8.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_9bfd39101d95260dd89f293bdeaf7db5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_9bfd39101d95260dd89f293bdeaf7db5.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_4dfd3cd3342212926c4350832d51ae21.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_4dfd3cd3342212926c4350832d51ae21.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_4d908daa7e65e114d7c4a7c15c09f8b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_4d908daa7e65e114d7c4a7c15c09f8b3.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_db573752280c358d5a5322ffe12e75b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_db573752280c358d5a5322ffe12e75b6.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_28fc5e53c01e855b9eb76554f53a4610.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_28fc5e53c01e855b9eb76554f53a4610.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_c36d01c6379e9b53bafb28603650feb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_c36d01c6379e9b53bafb28603650feb0.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_a43ebba584636b08cb37a3e9d9f4563f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_a43ebba584636b08cb37a3e9d9f4563f.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_cbf9195cb1680ddca1548f81c3677e1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_cbf9195cb1680ddca1548f81c3677e1c.jpg already downloaded
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fee%252F83ee8ed55468881aa5fb10afe0f0b371%252Fpa%252FNM33768_f13eeb84062d7dfc5df3f01f13bf8057.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_f13eeb84062d7dfc5df3f01f13bf8057.jpg already downloaded
2026-03-27 11:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78516ba2-6b22-5a5b-a721-9293f0a07342, identifier: NM33768
2026-03-27 11:35:24 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-27 11:35:24 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-27 11:35:24 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [auto1.be] INFO: Scrape type for ZR45530: 1
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_0ca5003a5f54295c30c3b3400d69ffab.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_0ca5003a5f54295c30c3b3400d69ffab.jpg not downloaded yet
2026-03-27 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE21401> (referer: https://www.auto1.com/v1/car-details-view/DE21401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC34183> (referer: https://www.auto1.com/v1/car-details-view/RC34183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-27 11:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768
2026-03-27 11:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78516ba2-6b22-5a5b-a721-9293f0a07342 with identifier: NM33768 to the API
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NM33768>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:24Z',
 'fuel_type': 'diesel',
 'id': '78516ba2-6b22-5a5b-a721-9293f0a07342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM33768',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 157935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_e850003bc7640f064cf6e58e7a7f57a8.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_9bfd39101d95260dd89f293bdeaf7db5.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_4dfd3cd3342212926c4350832d51ae21.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_4d908daa7e65e114d7c4a7c15c09f8b3.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_db573752280c358d5a5322ffe12e75b6.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_28fc5e53c01e855b9eb76554f53a4610.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_c36d01c6379e9b53bafb28603650feb0.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_a43ebba584636b08cb37a3e9d9f4563f.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_cbf9195cb1680ddca1548f81c3677e1c.jpg',
                'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_f13eeb84062d7dfc5df3f01f13bf8057.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_e850003bc7640f064cf6e58e7a7f57a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_9bfd39101d95260dd89f293bdeaf7db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61330,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_4dfd3cd3342212926c4350832d51ae21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52351,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_4d908daa7e65e114d7c4a7c15c09f8b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60338,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_db573752280c358d5a5322ffe12e75b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61435,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_28fc5e53c01e855b9eb76554f53a4610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51972,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_c36d01c6379e9b53bafb28603650feb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58229,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_a43ebba584636b08cb37a3e9d9f4563f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_cbf9195cb1680ddca1548f81c3677e1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78516ba2-6b22-5a5b-a721-9293f0a07342/78516ba2-6b22-5a5b-a721-9293f0a07342_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/ee/83ee8ed55468881aa5fb10afe0f0b371/pa/NM33768_f13eeb84062d7dfc5df3f01f13bf8057.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 dCi Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2012}
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [auto1.be] INFO: Saving data for NM33768: {'created_time': 1774611325.015862, 'last_price_update_time': 1774611325.015873, 'auction_closing_time': 1774714284.0}
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM33768') HTTP/1.1" 204 0
2026-03-27 11:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg not downloaded yet
2026-03-27 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS47815> (referer: https://www.auto1.com/v1/car-details-view/TS47815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_ab88b0ac0767b810f82c84b91774085a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ab88b0ac0767b810f82c84b91774085a.jpg not downloaded yet
2026-03-27 11:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_48b326529936e38481467827a14f7df9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_48b326529936e38481467827a14f7df9.jpg not downloaded yet
2026-03-27 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-27 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e211255-7efb-55df-a7e6-91faa685c42c with scrape type 1
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_930b877d43e2956fa3a5790e3b22a68e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_930b877d43e2956fa3a5790e3b22a68e.jpg not downloaded yet
2026-03-27 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183
2026-03-27 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525abdd4-961e-585d-88ae-5b1e31f41e1b with scrape type 1
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_25826463640f448c008bfc8de32b76ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_25826463640f448c008bfc8de32b76ac.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_af1eb72a6f3d8ca7734ad76813a8a9e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_af1eb72a6f3d8ca7734ad76813a8a9e1.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_ad3369e253bab8ee3c37a8e3d10c2ead.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_ad3369e253bab8ee3c37a8e3d10c2ead.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_678828303a37b5960ae948e8873b2080.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_678828303a37b5960ae948e8873b2080.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_51454b548fc9f85defb7ebca8bec8099.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_51454b548fc9f85defb7ebca8bec8099.jpg not downloaded yet
2026-03-27 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_96ee2683c000fd257455f47aeb71824c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_e4fa172f9a23a1361c3ecaf29f4b999a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_e4fa172f9a23a1361c3ecaf29f4b999a.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_245abdd4c87529c5a705a35db78b9e8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_245abdd4c87529c5a705a35db78b9e8d.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_792e31218bf026c354f2c3968d9f5861.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_792e31218bf026c354f2c3968d9f5861.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_59bdb052ede6e8a7d250d5b8ee08f418.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_59bdb052ede6e8a7d250d5b8ee08f418.jpg not downloaded yet
2026-03-27 11:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-27 11:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e7e6f1-e9bb-51de-89e5-d708d248f363 with scrape type 1
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e9e7e6f1-e9bb-51de-89e5-d708d248f363
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F99%252F709938c5a5fe7a02b2fccafac1394ce2%252Fpa%252FTS47815_d0de3b9fe3f7376458d52066fee86a61.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_d0de3b9fe3f7376458d52066fee86a61.jpg already downloaded
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F99%252F709938c5a5fe7a02b2fccafac1394ce2%252Fpa%252FTS47815_dce0d14e1ed95c47d8b45f52a73b3efe.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_dce0d14e1ed95c47d8b45f52a73b3efe.jpg already downloaded
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F99%252F709938c5a5fe7a02b2fccafac1394ce2%252Fpa%252FTS47815_5246db064131ae2a6a358d04f906ba78.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_5246db064131ae2a6a358d04f906ba78.jpg already downloaded
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F99%252F709938c5a5fe7a02b2fccafac1394ce2%252Fpa%252FTS47815_4ce5cd573325c74c590a2c4a7f77a885.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_4ce5cd573325c74c590a2c4a7f77a885.jpg already downloaded
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F99%252F709938c5a5fe7a02b2fccafac1394ce2%252Fpa%252FTS47815_e005d35989ee49e8bb906194d7da6005.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_e005d35989ee49e8bb906194d7da6005.jpg already downloaded
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F99%252F709938c5a5fe7a02b2fccafac1394ce2%252Fpa%252FTS47815_2905b0c9725fdda52838b92976444d8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_2905b0c9725fdda52838b92976444d8c.jpg already downloaded
2026-03-27 11:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9e7e6f1-e9bb-51de-89e5-d708d248f363, identifier: TS47815
2026-03-27 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_2e7939996c97b384c313fba1c407f4b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_c2d3ff4052e4c421e5a54fb80a7f0f05.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_c2d3ff4052e4c421e5a54fb80a7f0f05.jpg not downloaded yet
2026-03-27 11:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-27 11:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815
2026-03-27 11:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9e7e6f1-e9bb-51de-89e5-d708d248f363 with identifier: TS47815 to the API
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS47815>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:28:33Z',
 'fuel_type': 'diesel',
 'id': 'e9e7e6f1-e9bb-51de-89e5-d708d248f363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS47815',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 167217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_d0de3b9fe3f7376458d52066fee86a61.jpg',
                'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_dce0d14e1ed95c47d8b45f52a73b3efe.jpg',
                'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_5246db064131ae2a6a358d04f906ba78.jpg',
                'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_4ce5cd573325c74c590a2c4a7f77a885.jpg',
                'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_e005d35989ee49e8bb906194d7da6005.jpg',
                'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_2905b0c9725fdda52838b92976444d8c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e7e6f1-e9bb-51de-89e5-d708d248f363/e9e7e6f1-e9bb-51de-89e5-d708d248f363_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_d0de3b9fe3f7376458d52066fee86a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e7e6f1-e9bb-51de-89e5-d708d248f363/e9e7e6f1-e9bb-51de-89e5-d708d248f363_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_dce0d14e1ed95c47d8b45f52a73b3efe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e7e6f1-e9bb-51de-89e5-d708d248f363/e9e7e6f1-e9bb-51de-89e5-d708d248f363_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_5246db064131ae2a6a358d04f906ba78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e7e6f1-e9bb-51de-89e5-d708d248f363/e9e7e6f1-e9bb-51de-89e5-d708d248f363_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_4ce5cd573325c74c590a2c4a7f77a885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e7e6f1-e9bb-51de-89e5-d708d248f363/e9e7e6f1-e9bb-51de-89e5-d708d248f363_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_e005d35989ee49e8bb906194d7da6005.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9e7e6f1-e9bb-51de-89e5-d708d248f363/e9e7e6f1-e9bb-51de-89e5-d708d248f363_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/99/709938c5a5fe7a02b2fccafac1394ce2/pa/TS47815_2905b0c9725fdda52838b92976444d8c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD 70 Multijet Active',
 'transmission': 'manual',
 'trim': '70 Multijet Active',
 'year': 2004}
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [auto1.be] INFO: Saving data for TS47815: {'created_time': 1774611325.841954, 'last_price_update_time': 1774611325.841965, 'auction_closing_time': 1774715313.0}
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS47815') HTTP/1.1" 204 0
2026-03-27 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_334d4d08b4f1c9cdecd789afa5efd3eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_9cf272396fd80d90b4e9ef902fbac2a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_0e3f34aecffd151e8d77baddbbfe305a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_0e3f34aecffd151e8d77baddbbfe305a.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_6420226c69f07c0824f0d4c450812d5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_6420226c69f07c0824f0d4c450812d5b.jpg not downloaded yet
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_902c9a810bd624bef96c14fb07cedc20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_902c9a810bd624bef96c14fb07cedc20.jpg not downloaded yet
2026-03-27 11:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_ec6290d67e6182e5a5987b90c14df0da.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_fe4e12f2061557c338a26b814950e139.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_fe4e12f2061557c338a26b814950e139.jpg not downloaded yet
2026-03-27 11:35:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 11:35:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 11:35:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cec95d0>
2026-03-27 11:35:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_96ee2683c000fd257455f47aeb71824c.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_96ee2683c000fd257455f47aeb71824c.jpg saved to cache
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_512d81c84fdb269cb6d04eb3bb913bba.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_512d81c84fdb269cb6d04eb3bb913bba.jpg not downloaded yet
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_093703a835875852c6d6655a33320de6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_093703a835875852c6d6655a33320de6.jpg not downloaded yet
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE04651> (referer: https://www.auto1.com/v1/car-details-view/LE04651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU27000> (referer: https://www.auto1.com/v1/car-details-view/BU27000/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ced1210>
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_2e7939996c97b384c313fba1c407f4b5.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_2e7939996c97b384c313fba1c407f4b5.jpg saved to cache
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_ace872894f1cd7bd329bad590dd17168.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ace872894f1cd7bd329bad590dd17168.jpg not downloaded yet
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_51454b548fc9f85defb7ebca8bec8099.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_28c7d79d8759d0e5c6169b384f158378.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_28c7d79d8759d0e5c6169b384f158378.jpg not downloaded yet
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_fc6956913d97b9cf1421af318318e07d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_fc6956913d97b9cf1421af318318e07d.jpg not downloaded yet
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d923d10>
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_334d4d08b4f1c9cdecd789afa5efd3eb.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_334d4d08b4f1c9cdecd789afa5efd3eb.jpg saved to cache
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db444d0>
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_9cf272396fd80d90b4e9ef902fbac2a6.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_9cf272396fd80d90b4e9ef902fbac2a6.jpg saved to cache
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db7f950>
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_ec6290d67e6182e5a5987b90c14df0da.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_ec6290d67e6182e5a5987b90c14df0da.jpg saved to cache
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_80e0128405966b0c8ca88539bbae4bf4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_2d43113ed84beb98c8fb2516f312ab64.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_2d43113ed84beb98c8fb2516f312ab64.jpg not downloaded yet
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_f8128a14d8c08023a069788616324f2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f8128a14d8c08023a069788616324f2b.jpg not downloaded yet
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_327e97bdaa98597e72e7d9ddd158ca63.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_792e31218bf026c354f2c3968d9f5861.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_59bdb052ede6e8a7d250d5b8ee08f418.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-27 11:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with scrape type 1
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9fc4628-ca6c-5c67-ae80-c006e9f1dc69
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_a61d87d2f80e49e1b01e4b31377e3405.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_a61d87d2f80e49e1b01e4b31377e3405.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_509b59cb0c8a45ccf2fee2e228975249.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_509b59cb0c8a45ccf2fee2e228975249.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_ba0aa13541afce5d1f0f425837fdd87e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_ba0aa13541afce5d1f0f425837fdd87e.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_6b1afcfd9e9fb1ab7b8ee7240311426f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_6b1afcfd9e9fb1ab7b8ee7240311426f.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_75b1c8238e6eb59a80cfb6f1c794a41a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_75b1c8238e6eb59a80cfb6f1c794a41a.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_2bb0df08c17033daa2f3632e1dac4ab0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_2bb0df08c17033daa2f3632e1dac4ab0.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_6b2f1aae1789339d0d14e5fb44c5032a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_6b2f1aae1789339d0d14e5fb44c5032a.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_26806ca2ffa57fc86238c6f4b3eeb0ad.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_26806ca2ffa57fc86238c6f4b3eeb0ad.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_895df544e0d0a5575a7f4f6472b19f0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_895df544e0d0a5575a7f4f6472b19f0d.jpg already downloaded
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F51%252F2e51221c02d453911144a004baf10676%252Fpa%252FLE04651_c6e20331dd9bb8ae28fa4268f241a057.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_c6e20331dd9bb8ae28fa4268f241a057.jpg already downloaded
2026-03-27 11:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69, identifier: LE04651
2026-03-27 11:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-27 11:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25410665-1619-5ac3-bdfa-bb2c02232e4b with scrape type 1
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_69d69415af33ff7b5d95840e2520ee20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_69d69415af33ff7b5d95840e2520ee20.jpg not downloaded yet
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f9410>
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_51454b548fc9f85defb7ebca8bec8099.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_51454b548fc9f85defb7ebca8bec8099.jpg saved to cache
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_0ca5003a5f54295c30c3b3400d69ffab.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_c2d3ff4052e4c421e5a54fb80a7f0f05.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_f044f41319018532217a422134a1e47d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f044f41319018532217a422134a1e47d.jpg not downloaded yet
2026-03-27 11:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-27 11:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651
2026-03-27 11:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9fc4628-ca6c-5c67-ae80-c006e9f1dc69 with identifier: LE04651 to the API
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LE04651>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:57Z',
 'fuel_type': 'diesel',
 'id': 'b9fc4628-ca6c-5c67-ae80-c006e9f1dc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE04651',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 47608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_a61d87d2f80e49e1b01e4b31377e3405.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_509b59cb0c8a45ccf2fee2e228975249.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_ba0aa13541afce5d1f0f425837fdd87e.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_6b1afcfd9e9fb1ab7b8ee7240311426f.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_75b1c8238e6eb59a80cfb6f1c794a41a.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_2bb0df08c17033daa2f3632e1dac4ab0.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_6b2f1aae1789339d0d14e5fb44c5032a.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_26806ca2ffa57fc86238c6f4b3eeb0ad.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_895df544e0d0a5575a7f4f6472b19f0d.jpg',
                'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_c6e20331dd9bb8ae28fa4268f241a057.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_a61d87d2f80e49e1b01e4b31377e3405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_509b59cb0c8a45ccf2fee2e228975249.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_ba0aa13541afce5d1f0f425837fdd87e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_6b1afcfd9e9fb1ab7b8ee7240311426f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_75b1c8238e6eb59a80cfb6f1c794a41a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_2bb0df08c17033daa2f3632e1dac4ab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_6b2f1aae1789339d0d14e5fb44c5032a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_26806ca2ffa57fc86238c6f4b3eeb0ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_895df544e0d0a5575a7f4f6472b19f0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9fc4628-ca6c-5c67-ae80-c006e9f1dc69/b9fc4628-ca6c-5c67-ae80-c006e9f1dc69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/51/2e51221c02d453911144a004baf10676/pa/LE04651_c6e20331dd9bb8ae28fa4268f241a057.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 JTD SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2016}
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [auto1.be] INFO: Saving data for LE04651: {'created_time': 1774611327.2566, 'last_price_update_time': 1774611327.256612, 'auction_closing_time': 1774715337.0}
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE04651') HTTP/1.1" 204 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_174a24fff5019fe99ecd52d847268ab4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_174a24fff5019fe99ecd52d847268ab4.jpg not downloaded yet
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_902c9a810bd624bef96c14fb07cedc20.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_02f695f7c74a12b5846298c8132fdae6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_02f695f7c74a12b5846298c8132fdae6.jpg not downloaded yet
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU79691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU68669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH09444> (referer: https://www.auto1.com/v1/car-details-view/YH09444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP28046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d0659d0>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_80e0128405966b0c8ca88539bbae4bf4.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_80e0128405966b0c8ca88539bbae4bf4.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfdd2d0>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_327e97bdaa98597e72e7d9ddd158ca63.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_327e97bdaa98597e72e7d9ddd158ca63.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfc82d0>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_792e31218bf026c354f2c3968d9f5861.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_792e31218bf026c354f2c3968d9f5861.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf56050>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_59bdb052ede6e8a7d250d5b8ee08f418.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_59bdb052ede6e8a7d250d5b8ee08f418.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_fc6956913d97b9cf1421af318318e07d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_093703a835875852c6d6655a33320de6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ace872894f1cd7bd329bad590dd17168.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_55d82997095635c4737821729f4d6f4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_55d82997095635c4737821729f4d6f4f.jpg not downloaded yet
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM34078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_28c7d79d8759d0e5c6169b384f158378.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_203657bb19307bcd937b03f0db395581.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_203657bb19307bcd937b03f0db395581.jpg not downloaded yet
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db28210>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_0ca5003a5f54295c30c3b3400d69ffab.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_0ca5003a5f54295c30c3b3400d69ffab.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cee7010>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_c2d3ff4052e4c421e5a54fb80a7f0f05.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_c2d3ff4052e4c421e5a54fb80a7f0f05.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_e93d974cc88b61de4d9bda272855d8f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_e93d974cc88b61de4d9bda272855d8f2.jpg not downloaded yet
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_56c6037ed2cb7f987bcec99221629106.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_56c6037ed2cb7f987bcec99221629106.jpg not downloaded yet
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9fe3d0>
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_902c9a810bd624bef96c14fb07cedc20.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_902c9a810bd624bef96c14fb07cedc20.jpg saved to cache
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:27 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1870 | hits on page: 40
2026-03-27 11:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-27 11:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4abc93d3-0227-5f90-a27b-4ec27ca62880 with scrape type 1
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4abc93d3-0227-5f90-a27b-4ec27ca62880
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_7e742e51373a9fe1f5f5c0b36669763a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_7e742e51373a9fe1f5f5c0b36669763a.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_3bab00adee69365e9ec3c31922baa6ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_3bab00adee69365e9ec3c31922baa6ef.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_425d57be1ee1d427cde715f6deb70a77.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_425d57be1ee1d427cde715f6deb70a77.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_27ca0014b22006411fe559702661b617.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_27ca0014b22006411fe559702661b617.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_686f6ed32f3d8e7cc7bf73eb3e6f0d3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_686f6ed32f3d8e7cc7bf73eb3e6f0d3e.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_f67de116298a1f1f7e167b1abeed947b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_f67de116298a1f1f7e167b1abeed947b.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_d9946c6ba4e802c11d064dec89cea342.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_d9946c6ba4e802c11d064dec89cea342.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_c7f32075f429e3d71dc19591a705e35e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_c7f32075f429e3d71dc19591a705e35e.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_96a6638133fdabd0584fd94146f7d1d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_96a6638133fdabd0584fd94146f7d1d9.jpg already downloaded
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Faa%252Fe8aa1e3c3e9381d06f97a4e23e0b9644%252Fpa%252FYH09444_9e70b548f6315b35deacfd464bec4ebf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_9e70b548f6315b35deacfd464bec4ebf.jpg already downloaded
2026-03-27 11:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4abc93d3-0227-5f90-a27b-4ec27ca62880, identifier: YH09444
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da08a10>
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_fc6956913d97b9cf1421af318318e07d.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_fc6956913d97b9cf1421af318318e07d.jpg saved to cache
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccbb450>
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_093703a835875852c6d6655a33320de6.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_093703a835875852c6d6655a33320de6.jpg saved to cache
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d05b490>
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_ace872894f1cd7bd329bad590dd17168.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ace872894f1cd7bd329bad590dd17168.jpg saved to cache
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccb8450>
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_28c7d79d8759d0e5c6169b384f158378.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_28c7d79d8759d0e5c6169b384f158378.jpg saved to cache
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-27 11:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444
2026-03-27 11:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4abc93d3-0227-5f90-a27b-4ec27ca62880 with identifier: YH09444 to the API
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH09444>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:49Z',
 'fuel_type': 'diesel',
 'id': '4abc93d3-0227-5f90-a27b-4ec27ca62880',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH09444',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 97492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_7e742e51373a9fe1f5f5c0b36669763a.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_3bab00adee69365e9ec3c31922baa6ef.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_425d57be1ee1d427cde715f6deb70a77.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_27ca0014b22006411fe559702661b617.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_686f6ed32f3d8e7cc7bf73eb3e6f0d3e.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_f67de116298a1f1f7e167b1abeed947b.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_d9946c6ba4e802c11d064dec89cea342.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_c7f32075f429e3d71dc19591a705e35e.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_96a6638133fdabd0584fd94146f7d1d9.jpg',
                'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_9e70b548f6315b35deacfd464bec4ebf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_7e742e51373a9fe1f5f5c0b36669763a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_3bab00adee69365e9ec3c31922baa6ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_425d57be1ee1d427cde715f6deb70a77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_27ca0014b22006411fe559702661b617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_686f6ed32f3d8e7cc7bf73eb3e6f0d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_f67de116298a1f1f7e167b1abeed947b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_d9946c6ba4e802c11d064dec89cea342.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_c7f32075f429e3d71dc19591a705e35e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_96a6638133fdabd0584fd94146f7d1d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4abc93d3-0227-5f90-a27b-4ec27ca62880/4abc93d3-0227-5f90-a27b-4ec27ca62880_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/aa/e8aa1e3c3e9381d06f97a4e23e0b9644/pa/YH09444_9e70b548f6315b35deacfd464bec4ebf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [auto1.be] INFO: Saving data for YH09444: {'created_time': 1774611328.574673, 'last_price_update_time': 1774611328.574685, 'auction_closing_time': 1774714909.0}
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH09444') HTTP/1.1" 204 0
2026-03-27 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_512d81c84fdb269cb6d04eb3bb913bba.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_9596cb54410e2071d9630874ebcdcac8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_9596cb54410e2071d9630874ebcdcac8.jpg not downloaded yet
2026-03-27 11:35:28 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-27 11:35:28 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-27 11:35:28 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [auto1.be] INFO: Scrape type for LX45606: 1
2026-03-27 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f8128a14d8c08023a069788616324f2b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_174a24fff5019fe99ecd52d847268ab4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f044f41319018532217a422134a1e47d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_02f695f7c74a12b5846298c8132fdae6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_4b77d1cd220c8db63372f8bfb172ebbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_4b77d1cd220c8db63372f8bfb172ebbc.jpg not downloaded yet
2026-03-27 11:35:28 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [auto1.be] INFO: Scrape type for LC46636: 1
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_c1ec1b3954de6017827c5223deb21dae.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_c1ec1b3954de6017827c5223deb21dae.jpg not downloaded yet
2026-03-27 11:35:28 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-27 11:35:28 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-27 11:35:28 [auto1.be] INFO: Scrape type for AS01915: 2
2026-03-27 11:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-27 11:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c40a051-92bd-537a-9140-d36f2ea9d85f with scrape type 2
2026-03-27 11:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c40a051-92bd-537a-9140-d36f2ea9d85f with scrape type 2
2026-03-27 11:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c40a051-92bd-537a-9140-d36f2ea9d85f, identifier: AS01915
2026-03-27 11:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-27 11:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915
2026-03-27 11:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c40a051-92bd-537a-9140-d36f2ea9d85f with identifier: AS01915 to the API
2026-03-27 11:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:45:33Z',
 'fuel_type': 'petrol',
 'id': '9c40a051-92bd-537a-9140-d36f2ea9d85f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS01915',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 93339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-09',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-27 11:35:29 [auto1.be] INFO: Saving data for AS01915: {'auction_closing_time': 1774716333.0, 'created_time': 1773650189.72292, 'last_price_update_time': 1774611329.16574}
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AS01915') HTTP/1.1" 204 0
2026-03-27 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_69d69415af33ff7b5d95840e2520ee20.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_644385f96daec17d1f9980daac45ac9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_644385f96daec17d1f9980daac45ac9a.jpg not downloaded yet
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: RH61674
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH61674%27 HTTP/1.1" 200 None
2026-03-27 11:35:29 [auto1.be] INFO: Scrape type for RH61674: 1
2026-03-27 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_678828303a37b5960ae948e8873b2080.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_0e3f34aecffd151e8d77baddbbfe305a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_245abdd4c87529c5a705a35db78b9e8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_d0e35d89f41f83c5fa3e455996da2179.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_d0e35d89f41f83c5fa3e455996da2179.jpg not downloaded yet
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-27 11:35:29 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-27 11:35:29 [auto1.be] INFO: Scrape type for RA65802: 2
2026-03-27 11:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-27 11:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd6db043-d074-5a67-b1c0-b31b974993e8 with scrape type 2
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd6db043-d074-5a67-b1c0-b31b974993e8 with scrape type 2
2026-03-27 11:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd6db043-d074-5a67-b1c0-b31b974993e8, identifier: RA65802
2026-03-27 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d065290>
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_512d81c84fdb269cb6d04eb3bb913bba.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_512d81c84fdb269cb6d04eb3bb913bba.jpg saved to cache
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d02f2d0>
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_f8128a14d8c08023a069788616324f2b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f8128a14d8c08023a069788616324f2b.jpg saved to cache
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d962d90>
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_174a24fff5019fe99ecd52d847268ab4.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_174a24fff5019fe99ecd52d847268ab4.jpg saved to cache
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134dafea90>
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_f044f41319018532217a422134a1e47d.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f044f41319018532217a422134a1e47d.jpg saved to cache
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9636d0>
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_02f695f7c74a12b5846298c8132fdae6.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_02f695f7c74a12b5846298c8132fdae6.jpg saved to cache
2026-03-27 11:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-27 11:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802
2026-03-27 11:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd6db043-d074-5a67-b1c0-b31b974993e8 with identifier: RA65802 to the API
2026-03-27 11:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:14:15Z',
 'fuel_type': 'diesel',
 'id': 'cd6db043-d074-5a67-b1c0-b31b974993e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA65802',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 193714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2019}
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-27 11:35:30 [auto1.be] INFO: Saving data for RA65802: {'auction_closing_time': 1774714455.0, 'created_time': 1773223878.480023, 'last_price_update_time': 1774611330.197628}
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA65802') HTTP/1.1" 204 0
2026-03-27 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_6420226c69f07c0824f0d4c450812d5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:30 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-27 11:35:30 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-27 11:35:30 [auto1.be] INFO: Scrape type for FR21473: 2
2026-03-27 11:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-27 11:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with scrape type 2
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with scrape type 2
2026-03-27 11:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1, identifier: FR21473
2026-03-27 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_ad3369e253bab8ee3c37a8e3d10c2ead.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-27 11:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473
2026-03-27 11:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8c3eb4d-4d2b-59c5-aa67-3665c4f93af1 with identifier: FR21473 to the API
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:25:28Z',
 'fuel_type': 'diesel',
 'id': 'd8c3eb4d-4d2b-59c5-aa67-3665c4f93af1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR21473',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 146761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-27 11:35:30 [auto1.be] INFO: Saving data for FR21473: {'auction_closing_time': 1774715128.0, 'created_time': 1773909349.938396, 'last_price_update_time': 1774611330.659562}
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR21473') HTTP/1.1" 204 0
2026-03-27 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_25826463640f448c008bfc8de32b76ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_c1ec1b3954de6017827c5223deb21dae.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_af1eb72a6f3d8ca7734ad76813a8a9e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:30 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-27 11:35:30 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-27 11:35:30 [auto1.be] INFO: Scrape type for HL14568: 1
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf2b2d0>
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_69d69415af33ff7b5d95840e2520ee20.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_69d69415af33ff7b5d95840e2520ee20.jpg saved to cache
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d960550>
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_678828303a37b5960ae948e8873b2080.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_678828303a37b5960ae948e8873b2080.jpg saved to cache
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf1ba10>
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_0e3f34aecffd151e8d77baddbbfe305a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_0e3f34aecffd151e8d77baddbbfe305a.jpg saved to cache
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf4f390>
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_245abdd4c87529c5a705a35db78b9e8d.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_245abdd4c87529c5a705a35db78b9e8d.jpg saved to cache
2026-03-27 11:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134f965ed0>
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_6420226c69f07c0824f0d4c450812d5b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_6420226c69f07c0824f0d4c450812d5b.jpg saved to cache
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:31 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-27 11:35:31 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-27 11:35:31 [auto1.be] INFO: Scrape type for BR84638: 1
2026-03-27 11:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_d0e35d89f41f83c5fa3e455996da2179.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:31 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-27 11:35:31 [auto1.be] INFO: Scrape type for BW89679: 1
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf3c910>
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_ad3369e253bab8ee3c37a8e3d10c2ead.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_ad3369e253bab8ee3c37a8e3d10c2ead.jpg saved to cache
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf73f10>
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F85%252F27851ccdf5a9476511d34b4a196155cd%252Fpa%252FRC34183_25826463640f448c008bfc8de32b76ac.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_25826463640f448c008bfc8de32b76ac.jpg saved to cache
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 525abdd4-961e-585d-88ae-5b1e31f41e1b
2026-03-27 11:35:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 525abdd4-961e-585d-88ae-5b1e31f41e1b, skipping ID generation
2026-03-27 11:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525abdd4-961e-585d-88ae-5b1e31f41e1b with scrape type 1
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 525abdd4-961e-585d-88ae-5b1e31f41e1b sending to next pipeline
2026-03-27 11:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 525abdd4-961e-585d-88ae-5b1e31f41e1b, identifier: RC34183
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134f8f8150>
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_c1ec1b3954de6017827c5223deb21dae.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_c1ec1b3954de6017827c5223deb21dae.jpg saved to cache
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8df050>
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_af1eb72a6f3d8ca7734ad76813a8a9e1.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_af1eb72a6f3d8ca7734ad76813a8a9e1.jpg saved to cache
2026-03-27 11:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 11:35:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183
2026-03-27 11:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 525abdd4-961e-585d-88ae-5b1e31f41e1b with identifier: RC34183 to the API
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_25826463640f448c008bfc8de32b76ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:46:34Z',
 'fuel_type': 'diesel',
 'id': '525abdd4-961e-585d-88ae-5b1e31f41e1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC34183',
 'listing': 'auction',
 'location': 'BE, Leuven',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 182991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_25826463640f448c008bfc8de32b76ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_51454b548fc9f85defb7ebca8bec8099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_59bdb052ede6e8a7d250d5b8ee08f418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_902c9a810bd624bef96c14fb07cedc20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_093703a835875852c6d6655a33320de6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_525abdd4-961e-585d-88ae-5b1e31f41e1b/525abdd4-961e-585d-88ae-5b1e31f41e1b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/85/27851ccdf5a9476511d34b4a196155cd/pa/RC34183_fc6956913d97b9cf1421af318318e07d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fusion 1.6 TDCi Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2007}
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC34183%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Saving data for RC34183: {'created_time': 1774611332.110022, 'last_price_update_time': 1774611332.110034, 'auction_closing_time': 1774716394.0}
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC34183') HTTP/1.1" 204 0
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_4b77d1cd220c8db63372f8bfb172ebbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_56c6037ed2cb7f987bcec99221629106.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_9596cb54410e2071d9630874ebcdcac8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Scrape type for JV18684: 1
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_644385f96daec17d1f9980daac45ac9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH61674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP28046> (referer: https://www.auto1.com/v1/car-details-view/MP28046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU68669> (referer: https://www.auto1.com/v1/car-details-view/TU68669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM34078> (referer: https://www.auto1.com/v1/car-details-view/JM34078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Scrape type for RH07818: 1
2026-03-27 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU79691> (referer: https://www.auto1.com/v1/car-details-view/BU79691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ced05d0>
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_d0e35d89f41f83c5fa3e455996da2179.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_d0e35d89f41f83c5fa3e455996da2179.jpg saved to cache
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Scrape type for KV58178: 1
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ced2d10>
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_4b77d1cd220c8db63372f8bfb172ebbc.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_4b77d1cd220c8db63372f8bfb172ebbc.jpg saved to cache
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9090d0>
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_56c6037ed2cb7f987bcec99221629106.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_56c6037ed2cb7f987bcec99221629106.jpg saved to cache
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db22850>
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_9596cb54410e2071d9630874ebcdcac8.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_9596cb54410e2071d9630874ebcdcac8.jpg saved to cache
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_e4fa172f9a23a1361c3ecaf29f4b999a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-27 11:35:32 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Scrape type for ES19550: 2
2026-03-27 11:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-27 11:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd055418-f39a-5fdf-870a-43303d4beb5b with scrape type 2
2026-03-27 11:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd055418-f39a-5fdf-870a-43303d4beb5b with scrape type 2
2026-03-27 11:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd055418-f39a-5fdf-870a-43303d4beb5b, identifier: ES19550
2026-03-27 11:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_e93d974cc88b61de4d9bda272855d8f2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_55d82997095635c4737821729f4d6f4f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-27 11:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550
2026-03-27 11:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd055418-f39a-5fdf-870a-43303d4beb5b with identifier: ES19550 to the API
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:21:16Z',
 'fuel_type': 'hybrid',
 'id': 'fd055418-f39a-5fdf-870a-43303d4beb5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES19550',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 157904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-27 11:35:32 [auto1.be] INFO: Saving data for ES19550: {'auction_closing_time': 1774714876.0, 'created_time': 1773301743.386105, 'last_price_update_time': 1774611332.983508}
2026-03-27 11:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES19550') HTTP/1.1" 204 0
2026-03-27 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_48b326529936e38481467827a14f7df9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_930b877d43e2956fa3a5790e3b22a68e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:33 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-27 11:35:33 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-27 11:35:33 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-27 11:35:33 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [auto1.be] INFO: Scrape type for EM18277: 2
2026-03-27 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-27 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db494d34-2045-59d5-9f77-55413ffc9d5a with scrape type 2
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db494d34-2045-59d5-9f77-55413ffc9d5a with scrape type 2
2026-03-27 11:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db494d34-2045-59d5-9f77-55413ffc9d5a, identifier: EM18277
2026-03-27 11:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 11:35:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 11:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdbff50>
2026-03-27 11:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_644385f96daec17d1f9980daac45ac9a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_644385f96daec17d1f9980daac45ac9a.jpg saved to cache
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-27 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with scrape type 1
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg not downloaded yet
2026-03-27 11:35:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1870 | hits on page: 40
2026-03-27 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-27 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264d6f6f-4cd5-516c-b999-a468d4bea33b with scrape type 1
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_4113b638260c0adca08685fe200b6e8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_4113b638260c0adca08685fe200b6e8e.jpg not downloaded yet
2026-03-27 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-27 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89490faf-3f29-50b7-b5e6-da3866bc8354 with scrape type 1
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg not downloaded yet
2026-03-27 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691
2026-03-27 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with scrape type 1
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg not downloaded yet
2026-03-27 11:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_203657bb19307bcd937b03f0db395581.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 11:35:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277
2026-03-27 11:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db494d34-2045-59d5-9f77-55413ffc9d5a with identifier: EM18277 to the API
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'petrol',
 'id': 'db494d34-2045-59d5-9f77-55413ffc9d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM18277',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 59465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-04',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [auto1.be] INFO: Saving data for EM18277: {'auction_closing_time': 1774716349.0, 'created_time': 1773693560.455665, 'last_price_update_time': 1774611333.85969}
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM18277') HTTP/1.1" 204 0
2026-03-27 11:35:33 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-27 11:35:33 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-27 11:35:33 [auto1.be] INFO: Scrape type for KX60472: 2
2026-03-27 11:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-27 11:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f9931b-e043-58de-a6a3-ac39d976e4dd with scrape type 2
2026-03-27 11:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f9931b-e043-58de-a6a3-ac39d976e4dd with scrape type 2
2026-03-27 11:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a7f9931b-e043-58de-a6a3-ac39d976e4dd, identifier: KX60472
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_14fcad42f538e7f8ce2e352393c2395e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_14fcad42f538e7f8ce2e352393c2395e.jpg not downloaded yet
2026-03-27 11:35:34 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-27 11:35:34 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-27 11:35:34 [auto1.be] INFO: Scrape type for GG55355: 2
2026-03-27 11:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-27 11:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7bc5fe3-7a0a-591e-b851-acb764baf9fd with scrape type 2
2026-03-27 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7bc5fe3-7a0a-591e-b851-acb764baf9fd with scrape type 2
2026-03-27 11:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7bc5fe3-7a0a-591e-b851-acb764baf9fd, identifier: GG55355
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg not downloaded yet
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_5892a0613ca968aa70b3fad12f3ae536.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_5892a0613ca968aa70b3fad12f3ae536.jpg not downloaded yet
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_ab61831acb1c9593689d3e750c72ed5a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_ab61831acb1c9593689d3e750c72ed5a.jpg not downloaded yet
2026-03-27 11:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_fe4e12f2061557c338a26b814950e139.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-27 11:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472
2026-03-27 11:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a7f9931b-e043-58de-a6a3-ac39d976e4dd with identifier: KX60472 to the API
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:58:23Z',
 'fuel_type': 'hybrid',
 'id': 'a7f9931b-e043-58de-a6a3-ac39d976e4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX60472',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 106875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-27 11:35:34 [auto1.be] INFO: Saving data for KX60472: {'auction_closing_time': 1774717103.0, 'created_time': 1773866331.134586, 'last_price_update_time': 1774611334.573138}
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX60472') HTTP/1.1" 204 0
2026-03-27 11:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-27 11:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355
2026-03-27 11:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7bc5fe3-7a0a-591e-b851-acb764baf9fd with identifier: GG55355 to the API
2026-03-27 11:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:34:58Z',
 'fuel_type': 'petrol',
 'id': 'd7bc5fe3-7a0a-591e-b851-acb764baf9fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG55355',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 75467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T3 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-27 11:35:35 [auto1.be] INFO: Saving data for GG55355: {'auction_closing_time': 1774715698.0, 'created_time': 1773779753.352337, 'last_price_update_time': 1774611335.559353}
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG55355') HTTP/1.1" 204 0
2026-03-27 11:35:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfc1010>
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_e4fa172f9a23a1361c3ecaf29f4b999a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_e4fa172f9a23a1361c3ecaf29f4b999a.jpg saved to cache
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db23a50>
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_e93d974cc88b61de4d9bda272855d8f2.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_e93d974cc88b61de4d9bda272855d8f2.jpg saved to cache
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf5a650>
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F1d%252Fa41d83a2e43588917a54c647f51c19ed%252Fpa%252FBU27000_55d82997095635c4737821729f4d6f4f.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_55d82997095635c4737821729f4d6f4f.jpg saved to cache
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25410665-1619-5ac3-bdfa-bb2c02232e4b
2026-03-27 11:35:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25410665-1619-5ac3-bdfa-bb2c02232e4b, skipping ID generation
2026-03-27 11:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25410665-1619-5ac3-bdfa-bb2c02232e4b with scrape type 1
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25410665-1619-5ac3-bdfa-bb2c02232e4b sending to next pipeline
2026-03-27 11:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25410665-1619-5ac3-bdfa-bb2c02232e4b, identifier: BU27000
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce09850>
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_48b326529936e38481467827a14f7df9.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_48b326529936e38481467827a14f7df9.jpg saved to cache
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cd1c790>
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_930b877d43e2956fa3a5790e3b22a68e.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_930b877d43e2956fa3a5790e3b22a68e.jpg saved to cache
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:35 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-27 11:35:35 [auto1.be] INFO: Scrape type for HM69306: 2
2026-03-27 11:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-27 11:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11edb87a-b955-50bc-9cae-bc9047662547 with scrape type 2
2026-03-27 11:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11edb87a-b955-50bc-9cae-bc9047662547 with scrape type 2
2026-03-27 11:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11edb87a-b955-50bc-9cae-bc9047662547, identifier: HM69306
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_2d8d2ce68d2297f77f2d21e91e547726.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2d8d2ce68d2297f77f2d21e91e547726.jpg not downloaded yet
2026-03-27 11:35:36 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-27 11:35:36 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-27 11:35:36 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-27 11:35:36 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-27 11:35:36 [auto1.be] INFO: Scrape type for EG19315: 2
2026-03-27 11:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-27 11:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77e8956-d519-58ae-ae3a-8a4acd615628 with scrape type 2
2026-03-27 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77e8956-d519-58ae-ae3a-8a4acd615628 with scrape type 2
2026-03-27 11:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77e8956-d519-58ae-ae3a-8a4acd615628, identifier: EG19315
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_7698cd3df003bd4dc45f833610b679f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_7698cd3df003bd4dc45f833610b679f4.jpg not downloaded yet
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_52fcb3124ee7a30c2c4db5debbf94541.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_52fcb3124ee7a30c2c4db5debbf94541.jpg not downloaded yet
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_bca38556001e08cf7e59b7ab5ab977fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_bca38556001e08cf7e59b7ab5ab977fd.jpg not downloaded yet
2026-03-27 11:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-27 11:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000
2026-03-27 11:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25410665-1619-5ac3-bdfa-bb2c02232e4b with identifier: BU27000 to the API
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_55d82997095635c4737821729f4d6f4f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:47:23Z',
 'fuel_type': 'petrol',
 'id': '25410665-1619-5ac3-bdfa-bb2c02232e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU27000',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 111130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_69d69415af33ff7b5d95840e2520ee20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_174a24fff5019fe99ecd52d847268ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_55d82997095635c4737821729f4d6f4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_e93d974cc88b61de4d9bda272855d8f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_56c6037ed2cb7f987bcec99221629106.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_9596cb54410e2071d9630874ebcdcac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_4b77d1cd220c8db63372f8bfb172ebbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_c1ec1b3954de6017827c5223deb21dae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 419918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_644385f96daec17d1f9980daac45ac9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25410665-1619-5ac3-bdfa-bb2c02232e4b/25410665-1619-5ac3-bdfa-bb2c02232e4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/1d/a41d83a2e43588917a54c647f51c19ed/pa/BU27000_d0e35d89f41f83c5fa3e455996da2179.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Combo Life 1.2 Turbo Advance XL',
 'transmission': 'automatic',
 'trim': 'Advance XL',
 'year': 2020}
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-27 11:35:36 [auto1.be] INFO: Saving data for BU27000: {'created_time': 1774611336.608016, 'last_price_update_time': 1774611336.608029, 'auction_closing_time': 1774716443.0}
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU27000') HTTP/1.1" 204 0
2026-03-27 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_2d43113ed84beb98c8fb2516f312ab64.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_81acdae30b022e3ef404c4e4933515e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 11:35:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306
2026-03-27 11:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11edb87a-b955-50bc-9cae-bc9047662547 with identifier: HM69306 to the API
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:29:10Z',
 'fuel_type': 'petrol',
 'id': '11edb87a-b955-50bc-9cae-bc9047662547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM69306',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 63711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2016}
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [auto1.be] INFO: Saving data for HM69306: {'auction_closing_time': 1774715350.0, 'created_time': 1773780008.269331, 'last_price_update_time': 1774611337.062051}
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM69306') HTTP/1.1" 204 0
2026-03-27 11:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-27 11:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315
2026-03-27 11:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77e8956-d519-58ae-ae3a-8a4acd615628 with identifier: EG19315 to the API
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:33:25Z',
 'fuel_type': 'diesel',
 'id': 'b77e8956-d519-58ae-ae3a-8a4acd615628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG19315',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 127087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
 'transmission': 'manual',
 'trim': 'Driver M',
 'year': 2019}
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [auto1.be] INFO: Saving data for EG19315: {'auction_closing_time': 1774715605.0, 'created_time': 1773866679.754294, 'last_price_update_time': 1774611337.405972}
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG19315') HTTP/1.1" 204 0
2026-03-27 11:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccf7f50>
2026-03-27 11:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F13%252Fec1359179b4b5a97f4dcba55dd227f64%252Fpa%252FDE21401_203657bb19307bcd937b03f0db395581.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_203657bb19307bcd937b03f0db395581.jpg saved to cache
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e211255-7efb-55df-a7e6-91faa685c42c
2026-03-27 11:35:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e211255-7efb-55df-a7e6-91faa685c42c, skipping ID generation
2026-03-27 11:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e211255-7efb-55df-a7e6-91faa685c42c with scrape type 1
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e211255-7efb-55df-a7e6-91faa685c42c sending to next pipeline
2026-03-27 11:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e211255-7efb-55df-a7e6-91faa685c42c, identifier: DE21401
2026-03-27 11:35:37 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-27 11:35:37 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-27 11:35:37 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN53703%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [auto1.be] INFO: Scrape type for UN53703: 0
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_e3a197896e108d8ccc7ed377c617cda2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_e3a197896e108d8ccc7ed377c617cda2.jpg not downloaded yet
2026-03-27 11:35:37 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [auto1.be] INFO: Scrape type for CP13942: 2
2026-03-27 11:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-27 11:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4338ebf-0eaf-5282-8686-1617935d6bb1 with scrape type 2
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4338ebf-0eaf-5282-8686-1617935d6bb1 with scrape type 2
2026-03-27 11:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4338ebf-0eaf-5282-8686-1617935d6bb1, identifier: CP13942
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_365828aebbc85e89ab6626551e3d0a46.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_365828aebbc85e89ab6626551e3d0a46.jpg not downloaded yet
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_ab19183a3e2813f99db12934d66727f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ab19183a3e2813f99db12934d66727f3.jpg not downloaded yet
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_28196ee6221ca0d8a5434f1a5f8e1820.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_28196ee6221ca0d8a5434f1a5f8e1820.jpg not downloaded yet
2026-03-27 11:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 11:35:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401
2026-03-27 11:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e211255-7efb-55df-a7e6-91faa685c42c with identifier: DE21401 to the API
2026-03-27 11:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_203657bb19307bcd937b03f0db395581.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:27:08Z',
 'fuel_type': 'petrol',
 'id': '3e211255-7efb-55df-a7e6-91faa685c42c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE21401',
 'listing': 'auction',
 'location': 'BE, Charleroi',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 38598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_930b877d43e2956fa3a5790e3b22a68e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_678828303a37b5960ae948e8873b2080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_792e31218bf026c354f2c3968d9f5861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372681,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_6420226c69f07c0824f0d4c450812d5b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_512d81c84fdb269cb6d04eb3bb913bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_28c7d79d8759d0e5c6169b384f158378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 344134,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f8128a14d8c08023a069788616324f2b.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_f044f41319018532217a422134a1e47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_02f695f7c74a12b5846298c8132fdae6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e211255-7efb-55df-a7e6-91faa685c42c/3e211255-7efb-55df-a7e6-91faa685c42c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/13/ec1359179b4b5a97f4dcba55dd227f64/pa/DE21401_203657bb19307bcd937b03f0db395581.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-27 11:35:38 [auto1.be] INFO: Saving data for DE21401: {'created_time': 1774611338.263394, 'last_price_update_time': 1774611338.263407, 'auction_closing_time': 1774715228.0}
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE21401') HTTP/1.1" 204 0
2026-03-27 11:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-27 11:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942
2026-03-27 11:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4338ebf-0eaf-5282-8686-1617935d6bb1 with identifier: CP13942 to the API
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:15:00Z',
 'fuel_type': 'petrol',
 'id': 'b4338ebf-0eaf-5282-8686-1617935d6bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP13942',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 132096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-27 11:35:38 [auto1.be] INFO: Saving data for CP13942: {'auction_closing_time': 1774714500.0, 'created_time': 1773136511.516096, 'last_price_update_time': 1774611338.860338}
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP13942') HTTP/1.1" 204 0
2026-03-27 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW89679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR84638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL14568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV18684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfe89d0>
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_fe4e12f2061557c338a26b814950e139.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_fe4e12f2061557c338a26b814950e139.jpg saved to cache
2026-03-27 11:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccfb590>
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd2%252F0cd24c3ff32b79232d3de805607a15eb%252Fpa%252FVZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg saved to cache
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88
2026-03-27 11:35:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88, skipping ID generation
2026-03-27 11:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with scrape type 1
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 sending to next pipeline
2026-03-27 11:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88, identifier: VZ41655
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_a4606bcd13e6114aeb2f667942316662.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a4606bcd13e6114aeb2f667942316662.jpg not downloaded yet
2026-03-27 11:35:39 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-27 11:35:39 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-27 11:35:39 [auto1.be] INFO: Scrape type for CB53563: 2
2026-03-27 11:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-27 11:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ebb0529-d9de-5be2-821d-77f9a0813017 with scrape type 2
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ebb0529-d9de-5be2-821d-77f9a0813017 with scrape type 2
2026-03-27 11:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ebb0529-d9de-5be2-821d-77f9a0813017, identifier: CB53563
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_3a852833235fb269ce8d50e18c6ce2d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_3a852833235fb269ce8d50e18c6ce2d1.jpg not downloaded yet
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_a4515e39959c9a85b39f0187dd7da9fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_a4515e39959c9a85b39f0187dd7da9fa.jpg not downloaded yet
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_19cbb4d61fff2eaaf1019e54b7ebd193.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_19cbb4d61fff2eaaf1019e54b7ebd193.jpg not downloaded yet
2026-03-27 11:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV58178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655
2026-03-27 11:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655
2026-03-27 11:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b1683fd9-35d8-5d85-ba84-fd0a31fa4a88 with identifier: VZ41655 to the API
2026-03-27 11:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:34Z',
 'fuel_type': 'diesel',
 'id': 'b1683fd9-35d8-5d85-ba84-fd0a31fa4a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ41655',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 181878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_80e0128405966b0c8ca88539bbae4bf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_8f607f97d59cfcbf6a25244bf15a7e6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_48b326529936e38481467827a14f7df9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_ad3369e253bab8ee3c37a8e3d10c2ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_245abdd4c87529c5a705a35db78b9e8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1683fd9-35d8-5d85-ba84-fd0a31fa4a88/b1683fd9-35d8-5d85-ba84-fd0a31fa4a88_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d2/0cd24c3ff32b79232d3de805607a15eb/pa/VZ41655_0e3f34aecffd151e8d77baddbbfe305a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ41655%27 HTTP/1.1" 200 None
2026-03-27 11:35:40 [auto1.be] INFO: Saving data for VZ41655: {'created_time': 1774611340.86366, 'last_price_update_time': 1774611340.863673, 'auction_closing_time': 1774716394.0}
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ41655') HTTP/1.1" 204 0
2026-03-27 11:35:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9bd7d0>
2026-03-27 11:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_2d43113ed84beb98c8fb2516f312ab64.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_2d43113ed84beb98c8fb2516f312ab64.jpg saved to cache
2026-03-27 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cde0ed0>
2026-03-27 11:35:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_81acdae30b022e3ef404c4e4933515e1.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_81acdae30b022e3ef404c4e4933515e1.jpg saved to cache
2026-03-27 11:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-27 11:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563
2026-03-27 11:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ebb0529-d9de-5be2-821d-77f9a0813017 with identifier: CB53563 to the API
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:58Z',
 'fuel_type': 'diesel',
 'id': '8ebb0529-d9de-5be2-821d-77f9a0813017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB53563',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 179557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-27',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang FWD',
 'transmission': 'automatic',
 'trim': 'Kasten 35 mittellang FWD',
 'year': 2022}
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [auto1.be] INFO: Saving data for CB53563: {'auction_closing_time': 1774714678.0, 'created_time': 1773866674.169586, 'last_price_update_time': 1774611342.043429}
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB53563') HTTP/1.1" 204 0
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_bf7dd486496a2a0456dfbe27cf05413a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_bf7dd486496a2a0456dfbe27cf05413a.jpg not downloaded yet
2026-03-27 11:35:42 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [auto1.be] INFO: Scrape type for XC12599: 2
2026-03-27 11:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-27 11:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with scrape type 2
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with scrape type 2
2026-03-27 11:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f, identifier: XC12599
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_fda6e993068fc3afeb0663d0f6f57b63.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_fda6e993068fc3afeb0663d0f6f57b63.jpg not downloaded yet
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_894b9b1693db348ef5d51a178358b663.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_894b9b1693db348ef5d51a178358b663.jpg not downloaded yet
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_a94ba1b23bfb3ea43863c32fbe3ea695.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_a94ba1b23bfb3ea43863c32fbe3ea695.jpg not downloaded yet
2026-03-27 11:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-27 11:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599
2026-03-27 11:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f with identifier: XC12599 to the API
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:40:15Z',
 'fuel_type': 'diesel',
 'id': 'a4f5012b-ec4e-5cdf-9f92-f1d593cd4a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC12599',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 287576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-29',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [auto1.be] INFO: Saving data for XC12599: {'auction_closing_time': 1774716015.0, 'created_time': 1773223786.475416, 'last_price_update_time': 1774611342.596313}
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC12599') HTTP/1.1" 204 0
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_2e7b170f2f6af54315c1d6ae161ae787.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2e7b170f2f6af54315c1d6ae161ae787.jpg not downloaded yet
2026-03-27 11:35:42 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-27 11:35:42 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [auto1.be] INFO: Scrape type for CG84069: 2
2026-03-27 11:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-27 11:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with scrape type 2
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with scrape type 2
2026-03-27 11:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d67f2ac4-30c7-5b28-8227-5bc9aae0f290, identifier: CG84069
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_21c24cfc6a5a862a928afeb7086dde55.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_21c24cfc6a5a862a928afeb7086dde55.jpg not downloaded yet
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_ac95a8c97d2a79df9e9da5be640fdc98.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ac95a8c97d2a79df9e9da5be640fdc98.jpg not downloaded yet
2026-03-27 11:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC46636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-27 11:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069
2026-03-27 11:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d67f2ac4-30c7-5b28-8227-5bc9aae0f290 with identifier: CG84069 to the API
2026-03-27 11:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:32:59Z',
 'fuel_type': 'diesel',
 'id': 'd67f2ac4-30c7-5b28-8227-5bc9aae0f290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG84069',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 123027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-02',
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.5 Blue-HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2019}
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-27 11:35:43 [auto1.be] INFO: Saving data for CG84069: {'auction_closing_time': 1774715579.0, 'created_time': 1773747335.363558, 'last_price_update_time': 1774611343.572728}
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG84069') HTTP/1.1" 204 0
2026-03-27 11:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_a4515e39959c9a85b39f0187dd7da9fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_a2730f38cb773509e5b51e4694ced356.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a2730f38cb773509e5b51e4694ced356.jpg not downloaded yet
2026-03-27 11:35:43 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-27 11:35:43 [auto1.be] INFO: Scrape type for GV27154: 2
2026-03-27 11:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-27 11:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c972566e-1eff-57d5-a499-b4acc929719c with scrape type 2
2026-03-27 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c972566e-1eff-57d5-a499-b4acc929719c with scrape type 2
2026-03-27 11:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c972566e-1eff-57d5-a499-b4acc929719c, identifier: GV27154
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_26180449c57c36e1c340f8d85a9b6818.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_26180449c57c36e1c340f8d85a9b6818.jpg not downloaded yet
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_0ec8cac91a43d5b0efb4d4022dad0857.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_0ec8cac91a43d5b0efb4d4022dad0857.jpg not downloaded yet
2026-03-27 11:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_19cbb4d61fff2eaaf1019e54b7ebd193.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_28196ee6221ca0d8a5434f1a5f8e1820.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_365828aebbc85e89ab6626551e3d0a46.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_3a852833235fb269ce8d50e18c6ce2d1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-27 11:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154
2026-03-27 11:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c972566e-1eff-57d5-a499-b4acc929719c with identifier: GV27154 to the API
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:11:48Z',
 'fuel_type': 'diesel',
 'id': 'c972566e-1eff-57d5-a499-b4acc929719c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV27154',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 242398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-24',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [auto1.be] INFO: Saving data for GV27154: {'auction_closing_time': 1774714308.0, 'created_time': 1773866349.363217, 'last_price_update_time': 1774611344.093844}
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV27154') HTTP/1.1" 204 0
2026-03-27 11:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_7a6e0fbfdb5e999ca71db1c71560dae3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7a6e0fbfdb5e999ca71db1c71560dae3.jpg not downloaded yet
2026-03-27 11:35:44 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-27 11:35:44 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-27 11:35:44 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [auto1.be] INFO: Scrape type for HY77866: 2
2026-03-27 11:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-27 11:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c36cbd77-692c-5182-ad19-5eaa5a51c369 with scrape type 2
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c36cbd77-692c-5182-ad19-5eaa5a51c369 with scrape type 2
2026-03-27 11:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c36cbd77-692c-5182-ad19-5eaa5a51c369, identifier: HY77866
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_6aabc0c6209517ed15cb7e2052570233.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_6aabc0c6209517ed15cb7e2052570233.jpg not downloaded yet
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_8667754fd0e781b55a82a5e56fb435ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_8667754fd0e781b55a82a5e56fb435ac.jpg not downloaded yet
2026-03-27 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX45606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_e3a197896e108d8ccc7ed377c617cda2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-27 11:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866
2026-03-27 11:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c36cbd77-692c-5182-ad19-5eaa5a51c369 with identifier: HY77866 to the API
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:41Z',
 'fuel_type': 'diesel',
 'id': 'c36cbd77-692c-5182-ad19-5eaa5a51c369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY77866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 335380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [auto1.be] INFO: Saving data for HY77866: {'auction_closing_time': 1774717061.0, 'created_time': 1773301748.141352, 'last_price_update_time': 1774611344.581225}
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY77866') HTTP/1.1" 204 0
2026-03-27 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ac95a8c97d2a79df9e9da5be640fdc98.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_7d0f86db70848c7dfe1cccf47bba0563.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7d0f86db70848c7dfe1cccf47bba0563.jpg not downloaded yet
2026-03-27 11:35:44 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-27 11:35:44 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-27 11:35:44 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [auto1.be] INFO: Scrape type for ZS27075: 2
2026-03-27 11:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-27 11:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678b62c0-d967-5808-b137-82e400e254d3 with scrape type 2
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678b62c0-d967-5808-b137-82e400e254d3 with scrape type 2
2026-03-27 11:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 678b62c0-d967-5808-b137-82e400e254d3, identifier: ZS27075
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_2c6a412975d2d51b02b287ecc2a0e3e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_2c6a412975d2d51b02b287ecc2a0e3e8.jpg not downloaded yet
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_2cb21e3d0838e63ed6cf33a9f9c0e302.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_2cb21e3d0838e63ed6cf33a9f9c0e302.jpg not downloaded yet
2026-03-27 11:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9c89d0>
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_a4515e39959c9a85b39f0187dd7da9fa.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_a4515e39959c9a85b39f0187dd7da9fa.jpg saved to cache
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccb8190>
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_19cbb4d61fff2eaaf1019e54b7ebd193.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_19cbb4d61fff2eaaf1019e54b7ebd193.jpg saved to cache
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d92cbd0>
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_28196ee6221ca0d8a5434f1a5f8e1820.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_28196ee6221ca0d8a5434f1a5f8e1820.jpg saved to cache
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db66f50>
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_365828aebbc85e89ab6626551e3d0a46.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_365828aebbc85e89ab6626551e3d0a46.jpg saved to cache
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d92c790>
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_3a852833235fb269ce8d50e18c6ce2d1.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_3a852833235fb269ce8d50e18c6ce2d1.jpg saved to cache
2026-03-27 11:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_bca38556001e08cf7e59b7ab5ab977fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-27 11:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075
2026-03-27 11:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 678b62c0-d967-5808-b137-82e400e254d3 with identifier: ZS27075 to the API
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:30:03Z',
 'fuel_type': 'petrol',
 'id': '678b62c0-d967-5808-b137-82e400e254d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS27075',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 212246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2012}
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-27 11:35:45 [auto1.be] INFO: Saving data for ZS27075: {'auction_closing_time': 1774715403.0, 'created_time': 1773132399.338948, 'last_price_update_time': 1774611345.363548}
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS27075') HTTP/1.1" 204 0
2026-03-27 11:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_21c24cfc6a5a862a928afeb7086dde55.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2e7b170f2f6af54315c1d6ae161ae787.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:45 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-27 11:35:45 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-27 11:35:45 [auto1.be] INFO: Scrape type for YA85838: 2
2026-03-27 11:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-27 11:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d36432f7-496c-5fc3-813c-05aae0902e94 with scrape type 2
2026-03-27 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d36432f7-496c-5fc3-813c-05aae0902e94 with scrape type 2
2026-03-27 11:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d36432f7-496c-5fc3-813c-05aae0902e94, identifier: YA85838
2026-03-27 11:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH07818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce8d690>
2026-03-27 11:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_e3a197896e108d8ccc7ed377c617cda2.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_e3a197896e108d8ccc7ed377c617cda2.jpg saved to cache
2026-03-27 11:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-27 11:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838
2026-03-27 11:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d36432f7-496c-5fc3-813c-05aae0902e94 with identifier: YA85838 to the API
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:29:38Z',
 'fuel_type': 'diesel',
 'id': 'd36432f7-496c-5fc3-813c-05aae0902e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA85838',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 288011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-06',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2014}
2026-03-27 11:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-27 11:35:46 [auto1.be] INFO: Saving data for YA85838: {'auction_closing_time': 1774715378.0, 'created_time': 1774298173.703762, 'last_price_update_time': 1774611346.003018}
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA85838') HTTP/1.1" 204 0
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR45530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN18719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP69529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da15210>
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_ac95a8c97d2a79df9e9da5be640fdc98.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ac95a8c97d2a79df9e9da5be640fdc98.jpg saved to cache
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_8667754fd0e781b55a82a5e56fb435ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:46 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-27 11:35:46 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-27 11:35:46 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-27 11:35:46 [auto1.be] INFO: Scrape type for DK43204: 2
2026-03-27 11:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-27 11:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2107a4-633a-53da-93b0-31ec43c84d96 with scrape type 2
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c2107a4-633a-53da-93b0-31ec43c84d96 with scrape type 2
2026-03-27 11:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c2107a4-633a-53da-93b0-31ec43c84d96, identifier: DK43204
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_6aabc0c6209517ed15cb7e2052570233.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-27 11:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204
2026-03-27 11:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c2107a4-633a-53da-93b0-31ec43c84d96 with identifier: DK43204 to the API
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:38:49Z',
 'fuel_type': 'petrol',
 'id': '8c2107a4-633a-53da-93b0-31ec43c84d96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK43204',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 15318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2019}
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-27 11:35:46 [auto1.be] INFO: Saving data for DK43204: {'auction_closing_time': 1774715929.0, 'created_time': 1774298339.746073, 'last_price_update_time': 1774611346.538926}
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK43204') HTTP/1.1" 204 0
2026-03-27 11:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db7fe50>
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_bca38556001e08cf7e59b7ab5ab977fd.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_bca38556001e08cf7e59b7ab5ab977fd.jpg saved to cache
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf7bd0>
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_21c24cfc6a5a862a928afeb7086dde55.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_21c24cfc6a5a862a928afeb7086dde55.jpg saved to cache
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d04ed10>
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_2e7b170f2f6af54315c1d6ae161ae787.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2e7b170f2f6af54315c1d6ae161ae787.jpg saved to cache
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:46 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-27 11:35:46 [auto1.be] INFO: Scrape type for WU38196: 2
2026-03-27 11:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-27 11:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with scrape type 2
2026-03-27 11:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with scrape type 2
2026-03-27 11:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0, identifier: WU38196
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_2cb21e3d0838e63ed6cf33a9f9c0e302.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_2c6a412975d2d51b02b287ecc2a0e3e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-27 11:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196
2026-03-27 11:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17fcbdae-1902-5522-b6ca-a8d2f3691eb0 with identifier: WU38196 to the API
2026-03-27 11:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'petrol',
 'id': '17fcbdae-1902-5522-b6ca-a8d2f3691eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU38196',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 72881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-27',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2010}
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-27 11:35:47 [auto1.be] INFO: Saving data for WU38196: {'auction_closing_time': 1774714554.0, 'created_time': 1774298351.381626, 'last_price_update_time': 1774611347.198698}
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU38196') HTTP/1.1" 204 0
2026-03-27 11:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d0637d0>
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_8667754fd0e781b55a82a5e56fb435ac.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_8667754fd0e781b55a82a5e56fb435ac.jpg saved to cache
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7d0f86db70848c7dfe1cccf47bba0563.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:47 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-27 11:35:47 [auto1.be] INFO: Scrape type for AK84541: 2
2026-03-27 11:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-27 11:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with scrape type 2
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with scrape type 2
2026-03-27 11:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9, identifier: AK84541
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfd4310>
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_6aabc0c6209517ed15cb7e2052570233.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_6aabc0c6209517ed15cb7e2052570233.jpg saved to cache
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-27 11:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541
2026-03-27 11:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9 with identifier: AK84541 to the API
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:17:16Z',
 'fuel_type': 'diesel',
 'id': 'e8fbf2c6-1bbb-5a36-aa2f-315e010ccde9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK84541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 182639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2014}
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-27 11:35:47 [auto1.be] INFO: Saving data for AK84541: {'auction_closing_time': 1774714636.0, 'created_time': 1773693866.665572, 'last_price_update_time': 1774611347.737324}
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK84541') HTTP/1.1" 204 0
2026-03-27 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_0ec8cac91a43d5b0efb4d4022dad0857.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:47 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-27 11:35:47 [auto1.be] INFO: Scrape type for NB09051: 2
2026-03-27 11:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-27 11:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b2c403-f651-58aa-ae25-5fef150b7bd4 with scrape type 2
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b2c403-f651-58aa-ae25-5fef150b7bd4 with scrape type 2
2026-03-27 11:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58b2c403-f651-58aa-ae25-5fef150b7bd4, identifier: NB09051
2026-03-27 11:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL14568> (referer: https://www.auto1.com/v1/car-details-view/HL14568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da0a410>
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_2cb21e3d0838e63ed6cf33a9f9c0e302.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_2cb21e3d0838e63ed6cf33a9f9c0e302.jpg saved to cache
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f0f90>
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_2c6a412975d2d51b02b287ecc2a0e3e8.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_2c6a412975d2d51b02b287ecc2a0e3e8.jpg saved to cache
2026-03-27 11:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-27 11:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051
2026-03-27 11:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58b2c403-f651-58aa-ae25-5fef150b7bd4 with identifier: NB09051 to the API
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:30:50Z',
 'fuel_type': 'diesel',
 'id': '58b2c403-f651-58aa-ae25-5fef150b7bd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB09051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 41307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-27 11:35:48 [auto1.be] INFO: Saving data for NB09051: {'auction_closing_time': 1774715450.0, 'created_time': 1773909348.125255, 'last_price_update_time': 1774611348.286098}
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB09051') HTTP/1.1" 204 0
2026-03-27 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV58178> (referer: https://www.auto1.com/v1/car-details-view/KV58178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV18684> (referer: https://www.auto1.com/v1/car-details-view/JV18684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a2730f38cb773509e5b51e4694ced356.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_a94ba1b23bfb3ea43863c32fbe3ea695.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_26180449c57c36e1c340f8d85a9b6818.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:48 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-27 11:35:48 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-27 11:35:48 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-27 11:35:48 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-27 11:35:48 [auto1.be] INFO: Scrape type for YJ60132: 2
2026-03-27 11:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132
2026-03-27 11:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff22587-a47f-5bc3-8668-0a3488d72f8a with scrape type 2
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff22587-a47f-5bc3-8668-0a3488d72f8a with scrape type 2
2026-03-27 11:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dff22587-a47f-5bc3-8668-0a3488d72f8a, identifier: YJ60132
2026-03-27 11:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce509d0>
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_7d0f86db70848c7dfe1cccf47bba0563.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7d0f86db70848c7dfe1cccf47bba0563.jpg saved to cache
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_894b9b1693db348ef5d51a178358b663.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132
2026-03-27 11:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132
2026-03-27 11:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dff22587-a47f-5bc3-8668-0a3488d72f8a with identifier: YJ60132 to the API
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-28T16:39:31Z',
 'fuel_type': 'diesel',
 'id': 'dff22587-a47f-5bc3-8668-0a3488d72f8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ60132',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 319860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-13',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60132%27 HTTP/1.1" 200 None
2026-03-27 11:35:48 [auto1.be] INFO: Saving data for YJ60132: {'auction_closing_time': 1774715971.0, 'created_time': 1773909347.356356, 'last_price_update_time': 1774611348.802159}
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ60132') HTTP/1.1" 204 0
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db45250>
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_0ec8cac91a43d5b0efb4d4022dad0857.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_0ec8cac91a43d5b0efb4d4022dad0857.jpg saved to cache
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568
2026-03-27 11:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf025943-3ebe-55fe-af13-57de399c86c3 with scrape type 1
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_25fb7f00fa19f4c58c97ddbea87ba246.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_25fb7f00fa19f4c58c97ddbea87ba246.jpg not downloaded yet
2026-03-27 11:35:48 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-27 11:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-27 11:35:49 [auto1.be] INFO: Scrape type for WE53696: 2
2026-03-27 11:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-27 11:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a483acd3-a45f-5997-81bc-8906e425df72 with scrape type 2
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a483acd3-a45f-5997-81bc-8906e425df72 with scrape type 2
2026-03-27 11:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a483acd3-a45f-5997-81bc-8906e425df72, identifier: WE53696
2026-03-27 11:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-27 11:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696
2026-03-27 11:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a483acd3-a45f-5997-81bc-8906e425df72 with identifier: WE53696 to the API
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:16:19Z',
 'fuel_type': 'diesel',
 'id': 'a483acd3-a45f-5997-81bc-8906e425df72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE53696',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 251640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-08',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-27 11:35:49 [auto1.be] INFO: Saving data for WE53696: {'auction_closing_time': 1774714579.0, 'created_time': 1773136331.225977, 'last_price_update_time': 1774611349.517901}
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE53696') HTTP/1.1" 204 0
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_f42f6d5711a7502ea0883b2aec0bbfb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_f42f6d5711a7502ea0883b2aec0bbfb3.jpg not downloaded yet
2026-03-27 11:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178
2026-03-27 11:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13651d99-374d-5e33-8a53-ff4f5a1243bd with scrape type 1
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_b3e2f9651b00c7a3c619bef3c0eed6eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b3e2f9651b00c7a3c619bef3c0eed6eb.jpg not downloaded yet
2026-03-27 11:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-27 11:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18444be-aa2a-5ae1-b98e-e7994396df86 with scrape type 1
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_135c988e386f89155a3b3e11dc8895ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_135c988e386f89155a3b3e11dc8895ac.jpg not downloaded yet
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d921610>
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_a2730f38cb773509e5b51e4694ced356.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a2730f38cb773509e5b51e4694ced356.jpg saved to cache
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdc1450>
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_a94ba1b23bfb3ea43863c32fbe3ea695.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_a94ba1b23bfb3ea43863c32fbe3ea695.jpg saved to cache
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfc0410>
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_26180449c57c36e1c340f8d85a9b6818.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_26180449c57c36e1c340f8d85a9b6818.jpg saved to cache
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ab88b0ac0767b810f82c84b91774085a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_52fcb3124ee7a30c2c4db5debbf94541.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:49 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-27 11:35:49 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-27 11:35:49 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-27 11:35:49 [auto1.be] INFO: Scrape type for AV34296: 2
2026-03-27 11:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-27 11:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with scrape type 2
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with scrape type 2
2026-03-27 11:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb, identifier: AV34296
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da683d0>
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_894b9b1693db348ef5d51a178358b663.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_894b9b1693db348ef5d51a178358b663.jpg saved to cache
2026-03-27 11:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_fda6e993068fc3afeb0663d0f6f57b63.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_bf7dd486496a2a0456dfbe27cf05413a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-27 11:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296
2026-03-27 11:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb with identifier: AV34296 to the API
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'diesel',
 'id': '34ca1686-7a77-5b57-b1b1-4ac59c3ec4fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV34296',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 209412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2017}
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [auto1.be] INFO: Saving data for AV34296: {'auction_closing_time': 1774715126.0, 'created_time': 1773134257.558797, 'last_price_update_time': 1774611350.244875}
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AV34296') HTTP/1.1" 204 0
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg not downloaded yet
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_372084d521b2043df3719868fb56ba80.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_372084d521b2043df3719868fb56ba80.jpg not downloaded yet
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_178879c56983c737da7685ca23465495.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_178879c56983c737da7685ca23465495.jpg not downloaded yet
2026-03-27 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_7698cd3df003bd4dc45f833610b679f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:50 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [auto1.be] INFO: Scrape type for YJ44532: 2
2026-03-27 11:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-27 11:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50a7a112-8ff5-5456-9337-a4b1c69f3112 with scrape type 2
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50a7a112-8ff5-5456-9337-a4b1c69f3112 with scrape type 2
2026-03-27 11:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 50a7a112-8ff5-5456-9337-a4b1c69f3112, identifier: YJ44532
2026-03-27 11:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-27 11:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532
2026-03-27 11:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 50a7a112-8ff5-5456-9337-a4b1c69f3112 with identifier: YJ44532 to the API
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:20:46Z',
 'fuel_type': 'diesel',
 'id': '50a7a112-8ff5-5456-9337-a4b1c69f3112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ44532',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 151596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-29',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2012}
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [auto1.be] INFO: Saving data for YJ44532: {'auction_closing_time': 1774714846.0, 'created_time': 1773239951.955512, 'last_price_update_time': 1774611350.752671}
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ44532') HTTP/1.1" 204 0
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_6463e27c31681bf83601c31829827566.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_6463e27c31681bf83601c31829827566.jpg not downloaded yet
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_2b40007996d371228fb3c2948294c4af.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_2b40007996d371228fb3c2948294c4af.jpg not downloaded yet
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_f3c1aef152de96c42b5b1886eb6b576b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_f3c1aef152de96c42b5b1886eb6b576b.jpg not downloaded yet
2026-03-27 11:35:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db2bc90>
2026-03-27 11:35:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fe8%252F3be88b7e5233e9a4a2a1c04b80b06d09%252Fpa%252FTY10971_ab88b0ac0767b810f82c84b91774085a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ab88b0ac0767b810f82c84b91774085a.jpg saved to cache
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6
2026-03-27 11:35:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a682c635-bc6f-5ecb-a0f9-9944bcb943b6, skipping ID generation
2026-03-27 11:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with scrape type 1
2026-03-27 11:35:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a682c635-bc6f-5ecb-a0f9-9944bcb943b6 sending to next pipeline
2026-03-27 11:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a682c635-bc6f-5ecb-a0f9-9944bcb943b6, identifier: TY10971
2026-03-27 11:35:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8ff490>
2026-03-27 11:35:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_52fcb3124ee7a30c2c4db5debbf94541.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_52fcb3124ee7a30c2c4db5debbf94541.jpg saved to cache
2026-03-27 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:51 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-27 11:35:51 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-27 11:35:51 [auto1.be] INFO: Scrape type for LH25651: 2
2026-03-27 11:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-27 11:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9aa645-1b32-55df-a761-c8a57744de08 with scrape type 2
2026-03-27 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9aa645-1b32-55df-a761-c8a57744de08 with scrape type 2
2026-03-27 11:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e9aa645-1b32-55df-a761-c8a57744de08, identifier: LH25651
2026-03-27 11:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971
2026-03-27 11:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971
2026-03-27 11:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a682c635-bc6f-5ecb-a0f9-9944bcb943b6 with identifier: TY10971 to the API
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ab88b0ac0767b810f82c84b91774085a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:32:09Z',
 'fuel_type': 'hybrid',
 'id': 'a682c635-bc6f-5ecb-a0f9-9944bcb943b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY10971',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 191792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_81acdae30b022e3ef404c4e4933515e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_327e97bdaa98597e72e7d9ddd158ca63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_0ca5003a5f54295c30c3b3400d69ffab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2218697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ab88b0ac0767b810f82c84b91774085a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_af1eb72a6f3d8ca7734ad76813a8a9e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_e4fa172f9a23a1361c3ecaf29f4b999a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_c2d3ff4052e4c421e5a54fb80a7f0f05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420287,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_fe4e12f2061557c338a26b814950e139.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_ace872894f1cd7bd329bad590dd17168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a682c635-bc6f-5ecb-a0f9-9944bcb943b6/a682c635-bc6f-5ecb-a0f9-9944bcb943b6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2389411,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/e8/3be88b7e5233e9a4a2a1c04b80b06d09/pa/TY10971_2d43113ed84beb98c8fb2516f312ab64.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four Business Line',
 'transmission': 'automatic',
 'trim': 'E-Four Business Line',
 'year': 2017}
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY10971%27 HTTP/1.1" 200 None
2026-03-27 11:35:51 [auto1.be] INFO: Saving data for TY10971: {'created_time': 1774611351.616739, 'last_price_update_time': 1774611351.616751, 'auction_closing_time': 1774715529.0}
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY10971') HTTP/1.1" 204 0
2026-03-27 11:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-27 11:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651
2026-03-27 11:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e9aa645-1b32-55df-a761-c8a57744de08 with identifier: LH25651 to the API
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:47Z',
 'fuel_type': 'diesel',
 'id': '2e9aa645-1b32-55df-a761-c8a57744de08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH25651',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 250339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'manual',
 'trim': 'Standard',
 'year': 2009}
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-27 11:35:51 [auto1.be] INFO: Saving data for LH25651: {'auction_closing_time': 1774717007.0, 'created_time': 1773747602.992207, 'last_price_update_time': 1774611351.947045}
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH25651') HTTP/1.1" 204 0
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_0371c22d1c9d2a94f9b70ae4e5ee289d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_0371c22d1c9d2a94f9b70ae4e5ee289d.jpg not downloaded yet
2026-03-27 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_83f23f908c66861dca6cfac976b10b76.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_83f23f908c66861dca6cfac976b10b76.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_967afbd67cdf68421f98b5c04072d75e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_967afbd67cdf68421f98b5c04072d75e.jpg not downloaded yet
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce290d0>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_fda6e993068fc3afeb0663d0f6f57b63.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_fda6e993068fc3afeb0663d0f6f57b63.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9226d0>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_bf7dd486496a2a0456dfbe27cf05413a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_bf7dd486496a2a0456dfbe27cf05413a.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cd45790>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_7698cd3df003bd4dc45f833610b679f4.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_7698cd3df003bd4dc45f833610b679f4.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2d8d2ce68d2297f77f2d21e91e547726.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_135c988e386f89155a3b3e11dc8895ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b3e2f9651b00c7a3c619bef3c0eed6eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-27 11:35:52 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ69250%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [auto1.be] INFO: Scrape type for FJ69250: 0
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN18719> (referer: https://www.auto1.com/v1/car-details-view/EN18719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_f42f6d5711a7502ea0883b2aec0bbfb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_8fb542f42638662ea31a68f92fa2ba0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_8fb542f42638662ea31a68f92fa2ba0a.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_c05a7a41fb7868e83139301421eec21e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_c05a7a41fb7868e83139301421eec21e.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_addfdc2097ebe07180d99f99416445e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_addfdc2097ebe07180d99f99416445e2.jpg not downloaded yet
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX45606> (referer: https://www.auto1.com/v1/car-details-view/LX45606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP69529> (referer: https://www.auto1.com/v1/car-details-view/NP69529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW89679> (referer: https://www.auto1.com/v1/car-details-view/BW89679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH07818> (referer: https://www.auto1.com/v1/car-details-view/RH07818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR45530> (referer: https://www.auto1.com/v1/car-details-view/ZR45530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_615885b8751bf5e3a9d3d63ec65c7894.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_615885b8751bf5e3a9d3d63ec65c7894.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_da0698db2cb9d69e3706abdd70f8c266.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_da0698db2cb9d69e3706abdd70f8c266.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_4b1a45362e0108317d160c86dc28dc54.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_4b1a45362e0108317d160c86dc28dc54.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_29ae2189f3d0e61dd63c2f61f2c60c03.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_29ae2189f3d0e61dd63c2f61f2c60c03.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_b7e93af1d44e49ea9b6c02b31656e672.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7e93af1d44e49ea9b6c02b31656e672.jpg not downloaded yet
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_f3c1aef152de96c42b5b1886eb6b576b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_967afbd67cdf68421f98b5c04072d75e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_2b40007996d371228fb3c2948294c4af.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_ddda2956654e38aab5dff2355c47a43b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_ddda2956654e38aab5dff2355c47a43b.jpg not downloaded yet
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_b7331975af152b2ed9dba18b4817017c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7331975af152b2ed9dba18b4817017c.jpg not downloaded yet
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce839d0>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_2d8d2ce68d2297f77f2d21e91e547726.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2d8d2ce68d2297f77f2d21e91e547726.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8bdfd0>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_135c988e386f89155a3b3e11dc8895ac.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_135c988e386f89155a3b3e11dc8895ac.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfc00d0>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_b3e2f9651b00c7a3c619bef3c0eed6eb.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b3e2f9651b00c7a3c619bef3c0eed6eb.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-27 11:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cb3bb49-6bda-583f-99a8-71d676921b5f with scrape type 1
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cb3bb49-6bda-583f-99a8-71d676921b5f
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_2ccedb6834e4ffe023807dbe87b6613f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_2ccedb6834e4ffe023807dbe87b6613f.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_629232e216136af47687091adbe6ee10.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_629232e216136af47687091adbe6ee10.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_2eefa4ad772b5bcc44dfdfd294abb79d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_2eefa4ad772b5bcc44dfdfd294abb79d.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_86864fa97ae14bc44d56cbe1898eca7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_86864fa97ae14bc44d56cbe1898eca7e.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_5d04b91565d8d04f28109242ae2dc77f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_5d04b91565d8d04f28109242ae2dc77f.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_913b1b1494cf575de178eefc7cc1d0f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_913b1b1494cf575de178eefc7cc1d0f0.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_55113435cf24f123713ee0f235619174.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_55113435cf24f123713ee0f235619174.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_08bd6a2ea3b4b4b2fad40d24ffbdd81a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_08bd6a2ea3b4b4b2fad40d24ffbdd81a.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_888a20f38c085d35bbdc8d7584431d6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_888a20f38c085d35bbdc8d7584431d6f.jpg already downloaded
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fc3%252F60c3a42ad7eb1b8140c24e7848143dae%252Fpa%252FEN18719_d5ab942dfecbe51276b77e7f313c1493.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_d5ab942dfecbe51276b77e7f313c1493.jpg already downloaded
2026-03-27 11:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cb3bb49-6bda-583f-99a8-71d676921b5f, identifier: EN18719
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cee7710>
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_f42f6d5711a7502ea0883b2aec0bbfb3.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_f42f6d5711a7502ea0883b2aec0bbfb3.jpg saved to cache
2026-03-27 11:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ab19183a3e2813f99db12934d66727f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-27 11:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719
2026-03-27 11:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cb3bb49-6bda-583f-99a8-71d676921b5f with identifier: EN18719 to the API
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN18719>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:46:24Z',
 'fuel_type': 'petrol',
 'id': '8cb3bb49-6bda-583f-99a8-71d676921b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN18719',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 108145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_2ccedb6834e4ffe023807dbe87b6613f.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_629232e216136af47687091adbe6ee10.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_2eefa4ad772b5bcc44dfdfd294abb79d.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_86864fa97ae14bc44d56cbe1898eca7e.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_5d04b91565d8d04f28109242ae2dc77f.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_913b1b1494cf575de178eefc7cc1d0f0.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_55113435cf24f123713ee0f235619174.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_08bd6a2ea3b4b4b2fad40d24ffbdd81a.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_888a20f38c085d35bbdc8d7584431d6f.jpg',
                'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_d5ab942dfecbe51276b77e7f313c1493.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_2ccedb6834e4ffe023807dbe87b6613f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_629232e216136af47687091adbe6ee10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_2eefa4ad772b5bcc44dfdfd294abb79d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_86864fa97ae14bc44d56cbe1898eca7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_5d04b91565d8d04f28109242ae2dc77f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_913b1b1494cf575de178eefc7cc1d0f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_55113435cf24f123713ee0f235619174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_08bd6a2ea3b4b4b2fad40d24ffbdd81a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_888a20f38c085d35bbdc8d7584431d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cb3bb49-6bda-583f-99a8-71d676921b5f/8cb3bb49-6bda-583f-99a8-71d676921b5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/c3/60c3a42ad7eb1b8140c24e7848143dae/pa/EN18719_d5ab942dfecbe51276b77e7f313c1493.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [auto1.be] INFO: Saving data for EN18719: {'created_time': 1774611353.281007, 'last_price_update_time': 1774611353.28102, 'auction_closing_time': 1774716384.0}
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN18719') HTTP/1.1" 204 0
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_83c19c57bec4b0ab262a68bd15623d66.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_83c19c57bec4b0ab262a68bd15623d66.jpg not downloaded yet
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_9cc2fb330c2dc259c88e72ddb28c08d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_9cc2fb330c2dc259c88e72ddb28c08d9.jpg not downloaded yet
2026-03-27 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_6463e27c31681bf83601c31829827566.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-27 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb4a1a1-2934-5c80-a519-2323b635ccf3 with scrape type 1
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfb4a1a1-2934-5c80-a519-2323b635ccf3
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_b09a74d61c92a5738f868e2d01be1371.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_b09a74d61c92a5738f868e2d01be1371.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_8e4b028b124f3233f9446f1019fcb71c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_8e4b028b124f3233f9446f1019fcb71c.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_3157b6faca81531100f77c04273d11cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_3157b6faca81531100f77c04273d11cc.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_6020530ad2e14f8eeaab693e27da9f71.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_6020530ad2e14f8eeaab693e27da9f71.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_e5570d6d49791c388c8b18ab7f4cacf1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_e5570d6d49791c388c8b18ab7f4cacf1.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_25ccc32ddd0094701d373bcdcecc60d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_25ccc32ddd0094701d373bcdcecc60d4.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_914369f542629fe3ad4cdc4fa1751c09.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_914369f542629fe3ad4cdc4fa1751c09.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_d0c4f1aae5c65e368fecba53536e1f3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_d0c4f1aae5c65e368fecba53536e1f3b.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_075233e7d98b5efd36f3516e001458b3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_075233e7d98b5efd36f3516e001458b3.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fd9%252F05d94747b50076d8b0b60a7958cde216%252Fpa%252FLX45606_e6d7d0f0826df93a0e58d87b50cb00d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_e6d7d0f0826df93a0e58d87b50cb00d7.jpg already downloaded
2026-03-27 11:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bfb4a1a1-2934-5c80-a519-2323b635ccf3, identifier: LX45606
2026-03-27 11:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-27 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf917ded-7fe1-56cc-af78-e63f7a25bf1a with scrape type 1
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf917ded-7fe1-56cc-af78-e63f7a25bf1a
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_c69c63edc198647a3061e814063bbdfc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_c69c63edc198647a3061e814063bbdfc.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_bfa94a16488da1a895c6c55845bdda2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_bfa94a16488da1a895c6c55845bdda2e.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_97345c1cf7e0a63b000fe364b3a08374.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_97345c1cf7e0a63b000fe364b3a08374.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_2dfac8a40721c5cdd2581575c649f46b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_2dfac8a40721c5cdd2581575c649f46b.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_9f3de9315ea71297db00ea2d92829357.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_9f3de9315ea71297db00ea2d92829357.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_16c2300f8b17c78de0d89a81f1ed5806.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_16c2300f8b17c78de0d89a81f1ed5806.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_42dc4211a2f1f6194df6fb638bd28302.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_42dc4211a2f1f6194df6fb638bd28302.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_09c04caaedaea729d46fdb7cd0d70bca.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_09c04caaedaea729d46fdb7cd0d70bca.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_a4790b52c05bbfad85ac95c1b6fe61d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_a4790b52c05bbfad85ac95c1b6fe61d1.jpg already downloaded
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4e%252Fcf4eb64616f8dc449a73115a3ecfee54%252Fpa%252FNP69529_b9208b59a57fbcbdc75ef1843113b0a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_b9208b59a57fbcbdc75ef1843113b0a3.jpg already downloaded
2026-03-27 11:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf917ded-7fe1-56cc-af78-e63f7a25bf1a, identifier: NP69529
2026-03-27 11:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679
2026-03-27 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with scrape type 1
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_685ba223a6bab4fb09a45aafbfec9ede.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_685ba223a6bab4fb09a45aafbfec9ede.jpg not downloaded yet
2026-03-27 11:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-27 11:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 with scrape type 1
2026-03-27 11:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_58273b8f4bef903b07fe79ce80c40b5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_58273b8f4bef903b07fe79ce80c40b5c.jpg not downloaded yet
2026-03-27 11:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-27 11:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with scrape type 1
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_2cc8fbab046ce2c7c86cfb43c15dbdba.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_2cc8fbab046ce2c7c86cfb43c15dbdba.jpg not downloaded yet
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d969610>
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_f3c1aef152de96c42b5b1886eb6b576b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_f3c1aef152de96c42b5b1886eb6b576b.jpg saved to cache
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce42a10>
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_967afbd67cdf68421f98b5c04072d75e.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_967afbd67cdf68421f98b5c04072d75e.jpg saved to cache
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ceac790>
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_2b40007996d371228fb3c2948294c4af.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_2b40007996d371228fb3c2948294c4af.jpg saved to cache
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_178879c56983c737da7685ca23465495.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_83f23f908c66861dca6cfac976b10b76.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_0371c22d1c9d2a94f9b70ae4e5ee289d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_e66432526304291c51813f3e15e685ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_e66432526304291c51813f3e15e685ce.jpg not downloaded yet
2026-03-27 11:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-27 11:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606
2026-03-27 11:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bfb4a1a1-2934-5c80-a519-2323b635ccf3 with identifier: LX45606 to the API
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX45606>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.2L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:27:11Z',
 'fuel_type': 'diesel',
 'id': 'bfb4a1a1-2934-5c80-a519-2323b635ccf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX45606',
 'listing': 'auction',
 'location': 'BE, Milmort',
 'make': 'Ssangyong',
 'model': 'Rodius',
 'odometer': 276844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_b09a74d61c92a5738f868e2d01be1371.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_8e4b028b124f3233f9446f1019fcb71c.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_3157b6faca81531100f77c04273d11cc.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_6020530ad2e14f8eeaab693e27da9f71.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_e5570d6d49791c388c8b18ab7f4cacf1.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_25ccc32ddd0094701d373bcdcecc60d4.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_914369f542629fe3ad4cdc4fa1751c09.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_d0c4f1aae5c65e368fecba53536e1f3b.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_075233e7d98b5efd36f3516e001458b3.jpg',
                'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_e6d7d0f0826df93a0e58d87b50cb00d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_b09a74d61c92a5738f868e2d01be1371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_8e4b028b124f3233f9446f1019fcb71c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2540982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_3157b6faca81531100f77c04273d11cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2904962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_6020530ad2e14f8eeaab693e27da9f71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_e5570d6d49791c388c8b18ab7f4cacf1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_25ccc32ddd0094701d373bcdcecc60d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_914369f542629fe3ad4cdc4fa1751c09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_d0c4f1aae5c65e368fecba53536e1f3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_075233e7d98b5efd36f3516e001458b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfb4a1a1-2934-5c80-a519-2323b635ccf3/bfb4a1a1-2934-5c80-a519-2323b635ccf3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/d9/05d94747b50076d8b0b60a7958cde216/pa/LX45606_e6d7d0f0826df93a0e58d87b50cb00d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ssangyong Rodius 2.2 TD Sapphire 4WD',
 'transmission': 'automatic',
 'trim': 'Sapphire 4WD',
 'year': 2018}
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [auto1.be] INFO: Saving data for LX45606: {'created_time': 1774611354.488798, 'last_price_update_time': 1774611354.48881, 'auction_closing_time': 1774715231.0}
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LX45606') HTTP/1.1" 204 0
2026-03-27 11:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-27 11:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529
2026-03-27 11:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf917ded-7fe1-56cc-af78-e63f7a25bf1a with identifier: NP69529 to the API
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NP69529>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:16:13Z',
 'fuel_type': 'petrol',
 'id': 'cf917ded-7fe1-56cc-af78-e63f7a25bf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP69529',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 155186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_c69c63edc198647a3061e814063bbdfc.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_bfa94a16488da1a895c6c55845bdda2e.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_97345c1cf7e0a63b000fe364b3a08374.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_2dfac8a40721c5cdd2581575c649f46b.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_9f3de9315ea71297db00ea2d92829357.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_16c2300f8b17c78de0d89a81f1ed5806.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_42dc4211a2f1f6194df6fb638bd28302.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_09c04caaedaea729d46fdb7cd0d70bca.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_a4790b52c05bbfad85ac95c1b6fe61d1.jpg',
                'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_b9208b59a57fbcbdc75ef1843113b0a3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_c69c63edc198647a3061e814063bbdfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_bfa94a16488da1a895c6c55845bdda2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_97345c1cf7e0a63b000fe364b3a08374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_2dfac8a40721c5cdd2581575c649f46b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_9f3de9315ea71297db00ea2d92829357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_16c2300f8b17c78de0d89a81f1ed5806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_42dc4211a2f1f6194df6fb638bd28302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_09c04caaedaea729d46fdb7cd0d70bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_a4790b52c05bbfad85ac95c1b6fe61d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf917ded-7fe1-56cc-af78-e63f7a25bf1a/cf917ded-7fe1-56cc-af78-e63f7a25bf1a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/4e/cf4eb64616f8dc449a73115a3ecfee54/pa/NP69529_b9208b59a57fbcbdc75ef1843113b0a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [auto1.be] INFO: Saving data for NP69529: {'created_time': 1774611354.839513, 'last_price_update_time': 1774611354.83953, 'auction_closing_time': 1774714573.0}
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP69529') HTTP/1.1" 204 0
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_77707b93ac089d596bb28695d095f787.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_77707b93ac089d596bb28695d095f787.jpg not downloaded yet
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_75f40ce83fe0f3eeee4278878d59614d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_75f40ce83fe0f3eeee4278878d59614d.jpg not downloaded yet
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_f65cf61a50639423e6e40bed75135879.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_f65cf61a50639423e6e40bed75135879.jpg not downloaded yet
2026-03-27 11:35:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8c61d0>
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_ab19183a3e2813f99db12934d66727f3.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ab19183a3e2813f99db12934d66727f3.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_c05a7a41fb7868e83139301421eec21e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_addfdc2097ebe07180d99f99416445e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8ee750>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_6463e27c31681bf83601c31829827566.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_6463e27c31681bf83601c31829827566.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7e93af1d44e49ea9b6c02b31656e672.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_2e55f8d4c01b7a3d193f7fe27cabee61.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2e55f8d4c01b7a3d193f7fe27cabee61.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_708467d7656f0310fe3474c60ac72040.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_708467d7656f0310fe3474c60ac72040.jpg not downloaded yet
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db52310>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_178879c56983c737da7685ca23465495.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_178879c56983c737da7685ca23465495.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccc2c50>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_83f23f908c66861dca6cfac976b10b76.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_83f23f908c66861dca6cfac976b10b76.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccd5410>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_0371c22d1c9d2a94f9b70ae4e5ee289d.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_0371c22d1c9d2a94f9b70ae4e5ee289d.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_29ae2189f3d0e61dd63c2f61f2c60c03.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_8fb542f42638662ea31a68f92fa2ba0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR84638> (referer: https://www.auto1.com/v1/car-details-view/BR84638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_6d994ab125d7f61eb4ce878bcb86fe7b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6d994ab125d7f61eb4ce878bcb86fe7b.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_c270dc9139e38c62e8d25d2e14aa3b64.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_c270dc9139e38c62e8d25d2e14aa3b64.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_a136db5d63af9048c5569cffa9ea3e6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_a136db5d63af9048c5569cffa9ea3e6b.jpg not downloaded yet
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_4b1a45362e0108317d160c86dc28dc54.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdbd6d0>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_c05a7a41fb7868e83139301421eec21e.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_c05a7a41fb7868e83139301421eec21e.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cde0e50>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_addfdc2097ebe07180d99f99416445e2.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_addfdc2097ebe07180d99f99416445e2.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfdd350>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_b7e93af1d44e49ea9b6c02b31656e672.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7e93af1d44e49ea9b6c02b31656e672.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_9cc2fb330c2dc259c88e72ddb28c08d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_be75abf33afe0d6ebc91df0adbb70f7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_be75abf33afe0d6ebc91df0adbb70f7c.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_0b29ade3ccce74535eb96a1016119904.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_0b29ade3ccce74535eb96a1016119904.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_fad577e49d6d2208ca0086cc6e841811.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_fad577e49d6d2208ca0086cc6e841811.jpg not downloaded yet
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_83c19c57bec4b0ab262a68bd15623d66.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7331975af152b2ed9dba18b4817017c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_cc8e98150e4ba20209d065ed644d20a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_cc8e98150e4ba20209d065ed644d20a8.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_bfabab3164ef9a4d06f438e2bc533a5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_bfabab3164ef9a4d06f438e2bc533a5c.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_711853c76542aba4f2a4b7bc4683a7b8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_711853c76542aba4f2a4b7bc4683a7b8.jpg not downloaded yet
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a4606bcd13e6114aeb2f667942316662.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_e2b041cf4a3930e5d69657227c3e4bfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_e2b041cf4a3930e5d69657227c3e4bfe.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_2cdd0f72a8cd949514b2b596b9d596c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2cdd0f72a8cd949514b2b596b9d596c7.jpg not downloaded yet
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_b71bb7bfb0effcf5f892915d08c88846.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_b71bb7bfb0effcf5f892915d08c88846.jpg not downloaded yet
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf19610>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_29ae2189f3d0e61dd63c2f61f2c60c03.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_29ae2189f3d0e61dd63c2f61f2c60c03.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d954510>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_8fb542f42638662ea31a68f92fa2ba0a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_8fb542f42638662ea31a68f92fa2ba0a.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-27 11:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321116eb-2129-57ae-b68c-a7e210c6064e with scrape type 1
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_d116a82f3e0b8730c8caebfe68d35def.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_d116a82f3e0b8730c8caebfe68d35def.jpg not downloaded yet
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da43910>
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fda%252Fb7da8127ed52d51f2b60d5a94a55a718%252Fpa%252FJV18684_4b1a45362e0108317d160c86dc28dc54.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_4b1a45362e0108317d160c86dc28dc54.jpg saved to cache
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e18444be-aa2a-5ae1-b98e-e7994396df86
2026-03-27 11:35:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e18444be-aa2a-5ae1-b98e-e7994396df86, skipping ID generation
2026-03-27 11:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e18444be-aa2a-5ae1-b98e-e7994396df86 with scrape type 1
2026-03-27 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e18444be-aa2a-5ae1-b98e-e7994396df86 sending to next pipeline
2026-03-27 11:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e18444be-aa2a-5ae1-b98e-e7994396df86, identifier: JV18684
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_2cc8fbab046ce2c7c86cfb43c15dbdba.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_e66432526304291c51813f3e15e685ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-27 11:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684
2026-03-27 11:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e18444be-aa2a-5ae1-b98e-e7994396df86 with identifier: JV18684 to the API
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_4b1a45362e0108317d160c86dc28dc54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:51:53Z',
 'fuel_type': 'diesel',
 'id': 'e18444be-aa2a-5ae1-b98e-e7994396df86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV18684',
 'listing': 'auction',
 'location': 'BE, Mons',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 196540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_135c988e386f89155a3b3e11dc8895ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_178879c56983c737da7685ca23465495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_f3c1aef152de96c42b5b1886eb6b576b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_967afbd67cdf68421f98b5c04072d75e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_addfdc2097ebe07180d99f99416445e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e18444be-aa2a-5ae1-b98e-e7994396df86/e18444be-aa2a-5ae1-b98e-e7994396df86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/da/b7da8127ed52d51f2b60d5a94a55a718/pa/JV18684_4b1a45362e0108317d160c86dc28dc54.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [auto1.be] INFO: Saving data for JV18684: {'created_time': 1774611356.279584, 'last_price_update_time': 1774611356.279597, 'auction_closing_time': 1774716713.0}
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV18684') HTTP/1.1" 204 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_63177a28d82086b32b066c77a2f9a379.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_63177a28d82086b32b066c77a2f9a379.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_1f04131a3073cbe144f5309e6fb2ea23.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_1f04131a3073cbe144f5309e6fb2ea23.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_aba3bfc2eae7ee114fe4be51c3549e20.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_aba3bfc2eae7ee114fe4be51c3549e20.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_3e6e5c315734938a21327deae1d50167.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3e6e5c315734938a21327deae1d50167.jpg not downloaded yet
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da49190>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_9cc2fb330c2dc259c88e72ddb28c08d9.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_9cc2fb330c2dc259c88e72ddb28c08d9.jpg saved to cache
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7a6e0fbfdb5e999ca71db1c71560dae3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_ddda2956654e38aab5dff2355c47a43b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_f65cf61a50639423e6e40bed75135879.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_6e2efa14bfdddcdd8985d9b9eff4bd8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6e2efa14bfdddcdd8985d9b9eff4bd8a.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_af6845960c648929fa6f4c2b33de9587.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_af6845960c648929fa6f4c2b33de9587.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_68ad093912212e3fc369876ff5019a56.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_68ad093912212e3fc369876ff5019a56.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_c42092db7c6fca0d928568395ef4cdaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c42092db7c6fca0d928568395ef4cdaa.jpg not downloaded yet
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce783d0>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_83c19c57bec4b0ab262a68bd15623d66.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_83c19c57bec4b0ab262a68bd15623d66.jpg saved to cache
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9549d0>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_b7331975af152b2ed9dba18b4817017c.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7331975af152b2ed9dba18b4817017c.jpg saved to cache
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf19610>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_a4606bcd13e6114aeb2f667942316662.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a4606bcd13e6114aeb2f667942316662.jpg saved to cache
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db21550>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_2cc8fbab046ce2c7c86cfb43c15dbdba.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_2cc8fbab046ce2c7c86cfb43c15dbdba.jpg saved to cache
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8fec10>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_e66432526304291c51813f3e15e685ce.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_e66432526304291c51813f3e15e685ce.jpg saved to cache
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_4bce61a1591fe10fdb5b89ff33e86194.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_4bce61a1591fe10fdb5b89ff33e86194.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_e4792a9e0fba091fa9fb851aeb4aeda7.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_e4792a9e0fba091fa9fb851aeb4aeda7.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_46719575b8f919ba23b3c701f4bba433.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_46719575b8f919ba23b3c701f4bba433.jpg not downloaded yet
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_7594f4d23eeab87607d6690bdf1990c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_7594f4d23eeab87607d6690bdf1990c1.jpg not downloaded yet
2026-03-27 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_a136db5d63af9048c5569cffa9ea3e6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_708467d7656f0310fe3474c60ac72040.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d00c6d0>
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_7a6e0fbfdb5e999ca71db1c71560dae3.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7a6e0fbfdb5e999ca71db1c71560dae3.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d04dc90>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_ddda2956654e38aab5dff2355c47a43b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_ddda2956654e38aab5dff2355c47a43b.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf22650>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_f65cf61a50639423e6e40bed75135879.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_f65cf61a50639423e6e40bed75135879.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_77707b93ac089d596bb28695d095f787.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_c270dc9139e38c62e8d25d2e14aa3b64.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_43c9ae046ff862e96c1fd2f75aad7e52.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_43c9ae046ff862e96c1fd2f75aad7e52.jpg not downloaded yet
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_3fc21a3d2fa24f921d8213942c957ab0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3fc21a3d2fa24f921d8213942c957ab0.jpg not downloaded yet
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdd9d50>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_a136db5d63af9048c5569cffa9ea3e6b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_a136db5d63af9048c5569cffa9ea3e6b.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cd12090>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_708467d7656f0310fe3474c60ac72040.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_708467d7656f0310fe3474c60ac72040.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_61c017ad089b60b4e814ee9f27e66b0c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_61c017ad089b60b4e814ee9f27e66b0c.jpg not downloaded yet
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_d116a82f3e0b8730c8caebfe68d35def.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_b71bb7bfb0effcf5f892915d08c88846.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_6b2d2c37f8e844a47dd21a056223ca8b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_6b2d2c37f8e844a47dd21a056223ca8b.jpg not downloaded yet
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f7610>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_77707b93ac089d596bb28695d095f787.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_77707b93ac089d596bb28695d095f787.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cce0b50>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_c270dc9139e38c62e8d25d2e14aa3b64.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_c270dc9139e38c62e8d25d2e14aa3b64.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_25fb7f00fa19f4c58c97ddbea87ba246.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_711853c76542aba4f2a4b7bc4683a7b8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_c13e8dd7fbb8d9136e0dfc480a8dfb3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c13e8dd7fbb8d9136e0dfc480a8dfb3c.jpg not downloaded yet
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6d994ab125d7f61eb4ce878bcb86fe7b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_9218a8fec03d9cb0bb6661718c63a93a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_9218a8fec03d9cb0bb6661718c63a93a.jpg not downloaded yet
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf5010>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_d116a82f3e0b8730c8caebfe68d35def.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_d116a82f3e0b8730c8caebfe68d35def.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cddb2d0>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_b71bb7bfb0effcf5f892915d08c88846.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_b71bb7bfb0effcf5f892915d08c88846.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce09410>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_25fb7f00fa19f4c58c97ddbea87ba246.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_25fb7f00fa19f4c58c97ddbea87ba246.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f8a90>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_711853c76542aba4f2a4b7bc4683a7b8.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_711853c76542aba4f2a4b7bc4683a7b8.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_7594f4d23eeab87607d6690bdf1990c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_46719575b8f919ba23b3c701f4bba433.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_4bce61a1591fe10fdb5b89ff33e86194.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c42092db7c6fca0d928568395ef4cdaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8fafd0>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_6d994ab125d7f61eb4ce878bcb86fe7b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6d994ab125d7f61eb4ce878bcb86fe7b.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_da0698db2cb9d69e3706abdd70f8c266.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_75f40ce83fe0f3eeee4278878d59614d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2e55f8d4c01b7a3d193f7fe27cabee61.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c13e8dd7fbb8d9136e0dfc480a8dfb3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdd8090>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_7594f4d23eeab87607d6690bdf1990c1.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_7594f4d23eeab87607d6690bdf1990c1.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_9218a8fec03d9cb0bb6661718c63a93a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d05ae90>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_46719575b8f919ba23b3c701f4bba433.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_46719575b8f919ba23b3c701f4bba433.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce6d510>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_4bce61a1591fe10fdb5b89ff33e86194.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_4bce61a1591fe10fdb5b89ff33e86194.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134e7eea10>
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_c42092db7c6fca0d928568395ef4cdaa.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c42092db7c6fca0d928568395ef4cdaa.jpg saved to cache
2026-03-27 11:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_43c9ae046ff862e96c1fd2f75aad7e52.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_6b2d2c37f8e844a47dd21a056223ca8b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6e2efa14bfdddcdd8985d9b9eff4bd8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_68ad093912212e3fc369876ff5019a56.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3fc21a3d2fa24f921d8213942c957ab0.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccd9f50>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_da0698db2cb9d69e3706abdd70f8c266.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_da0698db2cb9d69e3706abdd70f8c266.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da88d10>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_75f40ce83fe0f3eeee4278878d59614d.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_75f40ce83fe0f3eeee4278878d59614d.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d04cf90>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_2e55f8d4c01b7a3d193f7fe27cabee61.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2e55f8d4c01b7a3d193f7fe27cabee61.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cce20d0>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_c13e8dd7fbb8d9136e0dfc480a8dfb3c.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c13e8dd7fbb8d9136e0dfc480a8dfb3c.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d04d050>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_9218a8fec03d9cb0bb6661718c63a93a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_9218a8fec03d9cb0bb6661718c63a93a.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_61c017ad089b60b4e814ee9f27e66b0c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_af6845960c648929fa6f4c2b33de9587.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3e6e5c315734938a21327deae1d50167.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d05ae10>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_43c9ae046ff862e96c1fd2f75aad7e52.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_43c9ae046ff862e96c1fd2f75aad7e52.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cce2d10>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_6b2d2c37f8e844a47dd21a056223ca8b.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_6b2d2c37f8e844a47dd21a056223ca8b.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce6f010>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_6e2efa14bfdddcdd8985d9b9eff4bd8a.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6e2efa14bfdddcdd8985d9b9eff4bd8a.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf73d0>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_68ad093912212e3fc369876ff5019a56.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_68ad093912212e3fc369876ff5019a56.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ceab190>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_3fc21a3d2fa24f921d8213942c957ab0.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3fc21a3d2fa24f921d8213942c957ab0.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_e2b041cf4a3930e5d69657227c3e4bfe.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_cc8e98150e4ba20209d065ed644d20a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d920ad0>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_61c017ad089b60b4e814ee9f27e66b0c.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_61c017ad089b60b4e814ee9f27e66b0c.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da88790>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_af6845960c648929fa6f4c2b33de9587.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_af6845960c648929fa6f4c2b33de9587.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9b2190>
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ff4%252Ffbf47163d7db69566ca3626dbb69cc2c%252Fpa%252FBR84638_3e6e5c315734938a21327deae1d50167.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3e6e5c315734938a21327deae1d50167.jpg saved to cache
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 321116eb-2129-57ae-b68c-a7e210c6064e
2026-03-27 11:35:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 321116eb-2129-57ae-b68c-a7e210c6064e, skipping ID generation
2026-03-27 11:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 321116eb-2129-57ae-b68c-a7e210c6064e with scrape type 1
2026-03-27 11:35:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 321116eb-2129-57ae-b68c-a7e210c6064e sending to next pipeline
2026-03-27 11:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 321116eb-2129-57ae-b68c-a7e210c6064e, identifier: BR84638
2026-03-27 11:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-27 11:35:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638
2026-03-27 11:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 321116eb-2129-57ae-b68c-a7e210c6064e with identifier: BR84638 to the API
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3e6e5c315734938a21327deae1d50167.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'petrol',
 'id': '321116eb-2129-57ae-b68c-a7e210c6064e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR84638',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 119956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_d116a82f3e0b8730c8caebfe68d35def.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3e6e5c315734938a21327deae1d50167.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c42092db7c6fca0d928568395ef4cdaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_7594f4d23eeab87607d6690bdf1990c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_43c9ae046ff862e96c1fd2f75aad7e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_3fc21a3d2fa24f921d8213942c957ab0.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_61c017ad089b60b4e814ee9f27e66b0c.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_6b2d2c37f8e844a47dd21a056223ca8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_c13e8dd7fbb8d9136e0dfc480a8dfb3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_321116eb-2129-57ae-b68c-a7e210c6064e/321116eb-2129-57ae-b68c-a7e210c6064e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/f4/fbf47163d7db69566ca3626dbb69cc2c/pa/BR84638_9218a8fec03d9cb0bb6661718c63a93a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-27 11:35:59 [auto1.be] INFO: Saving data for BR84638: {'created_time': 1774611359.688212, 'last_price_update_time': 1774611359.688224, 'auction_closing_time': 1774714544.0}
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR84638') HTTP/1.1" 204 0
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_aba3bfc2eae7ee114fe4be51c3549e20.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2cdd0f72a8cd949514b2b596b9d596c7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_bfabab3164ef9a4d06f438e2bc533a5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_63177a28d82086b32b066c77a2f9a379.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_fad577e49d6d2208ca0086cc6e841811.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fab65d0>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_e2b041cf4a3930e5d69657227c3e4bfe.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_e2b041cf4a3930e5d69657227c3e4bfe.jpg saved to cache
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134f8f8890>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_cc8e98150e4ba20209d065ed644d20a8.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_cc8e98150e4ba20209d065ed644d20a8.jpg saved to cache
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_58273b8f4bef903b07fe79ce80c40b5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_e4792a9e0fba091fa9fb851aeb4aeda7.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ceded90>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_aba3bfc2eae7ee114fe4be51c3549e20.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_aba3bfc2eae7ee114fe4be51c3549e20.jpg saved to cache
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbeab10>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_2cdd0f72a8cd949514b2b596b9d596c7.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2cdd0f72a8cd949514b2b596b9d596c7.jpg saved to cache
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cedc410>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_bfabab3164ef9a4d06f438e2bc533a5c.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_bfabab3164ef9a4d06f438e2bc533a5c.jpg saved to cache
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_685ba223a6bab4fb09a45aafbfec9ede.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_372084d521b2043df3719868fb56ba80.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_be75abf33afe0d6ebc91df0adbb70f7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134f9672d0>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_63177a28d82086b32b066c77a2f9a379.jpg') HTTP/1.1" 204 0
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_63177a28d82086b32b066c77a2f9a379.jpg saved to cache
2026-03-27 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce8de90>
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:35:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:35:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fd8%252F2ed8b4752b543b402f9066ba37d37b3d%252Fpa%252FZR45530_fad577e49d6d2208ca0086cc6e841811.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_fad577e49d6d2208ca0086cc6e841811.jpg saved to cache
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1
2026-03-27 11:36:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58be042d-1b7e-5467-b6e9-ade87f6ccce1, skipping ID generation
2026-03-27 11:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with scrape type 1
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58be042d-1b7e-5467-b6e9-ade87f6ccce1 sending to next pipeline
2026-03-27 11:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58be042d-1b7e-5467-b6e9-ade87f6ccce1, identifier: ZR45530
2026-03-27 11:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce0a950>
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_58273b8f4bef903b07fe79ce80c40b5c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_58273b8f4bef903b07fe79ce80c40b5c.jpg saved to cache
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:36:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdd9390>
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_e4792a9e0fba091fa9fb851aeb4aeda7.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_e4792a9e0fba091fa9fb851aeb4aeda7.jpg saved to cache
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_615885b8751bf5e3a9d3d63ec65c7894.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-27 11:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530
2026-03-27 11:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58be042d-1b7e-5467-b6e9-ade87f6ccce1 with identifier: ZR45530 to the API
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_fad577e49d6d2208ca0086cc6e841811.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:15Z',
 'fuel_type': 'diesel',
 'id': '58be042d-1b7e-5467-b6e9-ade87f6ccce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR45530',
 'listing': 'auction',
 'location': 'BE, Temse',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 223109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_2cc8fbab046ce2c7c86cfb43c15dbdba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_f65cf61a50639423e6e40bed75135879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_708467d7656f0310fe3474c60ac72040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_a136db5d63af9048c5569cffa9ea3e6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_fad577e49d6d2208ca0086cc6e841811.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_711853c76542aba4f2a4b7bc4683a7b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_b71bb7bfb0effcf5f892915d08c88846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_aba3bfc2eae7ee114fe4be51c3549e20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_68ad093912212e3fc369876ff5019a56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58be042d-1b7e-5467-b6e9-ade87f6ccce1/58be042d-1b7e-5467-b6e9-ade87f6ccce1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/d8/2ed8b4752b543b402f9066ba37d37b3d/pa/ZR45530_46719575b8f919ba23b3c701f4bba433.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueTDI',
 'transmission': 'manual',
 'trim': 'Comfortline BlueTDI',
 'year': 2013}
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-27 11:36:00 [auto1.be] INFO: Saving data for ZR45530: {'created_time': 1774611360.700796, 'last_price_update_time': 1774611360.700809, 'auction_closing_time': 1774715055.0}
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR45530') HTTP/1.1" 204 0
2026-03-27 11:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_5892a0613ca968aa70b3fad12f3ae536.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_ab61831acb1c9593689d3e750c72ed5a.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da8b490>
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_685ba223a6bab4fb09a45aafbfec9ede.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_685ba223a6bab4fb09a45aafbfec9ede.jpg saved to cache
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccf2cd0>
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F0d%252Ff50d1a91d61c200ebd640a17754975e0%252Fpa%252FKV58178_372084d521b2043df3719868fb56ba80.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_372084d521b2043df3719868fb56ba80.jpg saved to cache
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13651d99-374d-5e33-8a53-ff4f5a1243bd
2026-03-27 11:36:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13651d99-374d-5e33-8a53-ff4f5a1243bd, skipping ID generation
2026-03-27 11:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13651d99-374d-5e33-8a53-ff4f5a1243bd with scrape type 1
2026-03-27 11:36:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13651d99-374d-5e33-8a53-ff4f5a1243bd sending to next pipeline
2026-03-27 11:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 13651d99-374d-5e33-8a53-ff4f5a1243bd, identifier: KV58178
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf32d0>
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_be75abf33afe0d6ebc91df0adbb70f7c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_be75abf33afe0d6ebc91df0adbb70f7c.jpg saved to cache
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce8fe10>
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_615885b8751bf5e3a9d3d63ec65c7894.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_615885b8751bf5e3a9d3d63ec65c7894.jpg saved to cache
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178
2026-03-27 11:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178
2026-03-27 11:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 13651d99-374d-5e33-8a53-ff4f5a1243bd with identifier: KV58178 to the API
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_372084d521b2043df3719868fb56ba80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:52:05Z',
 'fuel_type': 'diesel',
 'id': '13651d99-374d-5e33-8a53-ff4f5a1243bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV58178',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 207524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b3e2f9651b00c7a3c619bef3c0eed6eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_372084d521b2043df3719868fb56ba80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_2b40007996d371228fb3c2948294c4af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_83f23f908c66861dca6cfac976b10b76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_c05a7a41fb7868e83139301421eec21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_da0698db2cb9d69e3706abdd70f8c266.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7e93af1d44e49ea9b6c02b31656e672.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_b7331975af152b2ed9dba18b4817017c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_9cc2fb330c2dc259c88e72ddb28c08d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13651d99-374d-5e33-8a53-ff4f5a1243bd/13651d99-374d-5e33-8a53-ff4f5a1243bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/0d/f50d1a91d61c200ebd640a17754975e0/pa/KV58178_e66432526304291c51813f3e15e685ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 S',
 'transmission': 'automatic',
 'trim': 'TDV6 S',
 'year': 2011}
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV58178%27 HTTP/1.1" 200 None
2026-03-27 11:36:01 [auto1.be] INFO: Saving data for KV58178: {'created_time': 1774611361.482143, 'last_price_update_time': 1774611361.482155, 'auction_closing_time': 1774716725.0}
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV58178') HTTP/1.1" 204 0
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9f5c10>
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F5b%252F435b5fbd9248faf64ccfc41436b56827%252Fpa%252FBW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg saved to cache
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563
2026-03-27 11:36:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1801731b-c1dd-5ecc-8d62-899ecd9b1563, skipping ID generation
2026-03-27 11:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with scrape type 1
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1801731b-c1dd-5ecc-8d62-899ecd9b1563 sending to next pipeline
2026-03-27 11:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1801731b-c1dd-5ecc-8d62-899ecd9b1563, identifier: BW89679
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccf3b50>
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_5892a0613ca968aa70b3fad12f3ae536.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_5892a0613ca968aa70b3fad12f3ae536.jpg saved to cache
2026-03-27 11:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_4113b638260c0adca08685fe200b6e8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_14fcad42f538e7f8ce2e352393c2395e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679
2026-03-27 11:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679
2026-03-27 11:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1801731b-c1dd-5ecc-8d62-899ecd9b1563 with identifier: BW89679 to the API
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:46:26Z',
 'fuel_type': 'diesel',
 'id': '1801731b-c1dd-5ecc-8d62-899ecd9b1563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW89679',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 141603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_685ba223a6bab4fb09a45aafbfec9ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_77707b93ac089d596bb28695d095f787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_602c19fcf92b7f1c7b42ba09cdd50354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6d994ab125d7f61eb4ce878bcb86fe7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_be75abf33afe0d6ebc91df0adbb70f7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_cc8e98150e4ba20209d065ed644d20a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_e2b041cf4a3930e5d69657227c3e4bfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_63177a28d82086b32b066c77a2f9a379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_6e2efa14bfdddcdd8985d9b9eff4bd8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1801731b-c1dd-5ecc-8d62-899ecd9b1563/1801731b-c1dd-5ecc-8d62-899ecd9b1563_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/5b/435b5fbd9248faf64ccfc41436b56827/pa/BW89679_4bce61a1591fe10fdb5b89ff33e86194.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW89679%27 HTTP/1.1" 200 None
2026-03-27 11:36:02 [auto1.be] INFO: Saving data for BW89679: {'created_time': 1774611362.047716, 'last_price_update_time': 1774611362.047728, 'auction_closing_time': 1774716386.0}
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BW89679') HTTP/1.1" 204 0
2026-03-27 11:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134e819d10>
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_ab61831acb1c9593689d3e750c72ed5a.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_ab61831acb1c9593689d3e750c72ed5a.jpg saved to cache
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f5010>
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fb6%252F22b6d6cd07e813452d7c4514d5019d7e%252Fpa%252FJM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg saved to cache
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89490faf-3f29-50b7-b5e6-da3866bc8354
2026-03-27 11:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89490faf-3f29-50b7-b5e6-da3866bc8354, skipping ID generation
2026-03-27 11:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89490faf-3f29-50b7-b5e6-da3866bc8354 with scrape type 1
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89490faf-3f29-50b7-b5e6-da3866bc8354 sending to next pipeline
2026-03-27 11:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89490faf-3f29-50b7-b5e6-da3866bc8354, identifier: JM34078
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce53a10>
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fcb%252Febcb16f77cf8c08ddccc3f166690c112%252Fpa%252FBU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg saved to cache
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6
2026-03-27 11:36:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6, skipping ID generation
2026-03-27 11:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with scrape type 1
2026-03-27 11:36:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 sending to next pipeline
2026-03-27 11:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6, identifier: BU79691
2026-03-27 11:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_182e4677545b2f8330d212b632acac4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-27 11:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078
2026-03-27 11:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89490faf-3f29-50b7-b5e6-da3866bc8354 with identifier: JM34078 to the API
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:07:17Z',
 'fuel_type': 'diesel',
 'id': '89490faf-3f29-50b7-b5e6-da3866bc8354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM34078',
 'listing': 'auction',
 'location': 'BE, Aalst',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 198206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_415dd592ea0a5804ac0fc6cd219499ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_5892a0613ca968aa70b3fad12f3ae536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_52fcb3124ee7a30c2c4db5debbf94541.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2269409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ab19183a3e2813f99db12934d66727f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_a4515e39959c9a85b39f0187dd7da9fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_894b9b1693db348ef5d51a178358b663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_ac95a8c97d2a79df9e9da5be640fdc98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_0ec8cac91a43d5b0efb4d4022dad0857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_8667754fd0e781b55a82a5e56fb435ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89490faf-3f29-50b7-b5e6-da3866bc8354/89490faf-3f29-50b7-b5e6-da3866bc8354_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/b6/22b6d6cd07e813452d7c4514d5019d7e/pa/JM34078_2cb21e3d0838e63ed6cf33a9f9c0e302.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L2H1 3,0t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 3,0t',
 'year': 2018}
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-27 11:36:02 [auto1.be] INFO: Saving data for JM34078: {'created_time': 1774611362.735349, 'last_price_update_time': 1774611362.735361, 'auction_closing_time': 1774714037.0}
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM34078') HTTP/1.1" 204 0
2026-03-27 11:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691
2026-03-27 11:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691
2026-03-27 11:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a47dfb16-f2aa-5412-8073-6aca1f2d5ad6 with identifier: BU79691 to the API
2026-03-27 11:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': 'a47dfb16-f2aa-5412-8073-6aca1f2d5ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU79691',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 118599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_64b5ef8abd3e61e4694acd26e4cb1f88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_ab61831acb1c9593689d3e750c72ed5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_bca38556001e08cf7e59b7ab5ab977fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_28196ee6221ca0d8a5434f1a5f8e1820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_19cbb4d61fff2eaaf1019e54b7ebd193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a47dfb16-f2aa-5412-8073-6aca1f2d5ad6/a47dfb16-f2aa-5412-8073-6aca1f2d5ad6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/cb/ebcb16f77cf8c08ddccc3f166690c112/pa/BU79691_a94ba1b23bfb3ea43863c32fbe3ea695.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 IMusic Pack Dynamique',
 'transmission': 'manual',
 'trim': 'IMusic Pack Dynamique',
 'year': 2011}
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU79691%27 HTTP/1.1" 200 None
2026-03-27 11:36:03 [auto1.be] INFO: Saving data for BU79691: {'created_time': 1774611363.118275, 'last_price_update_time': 1774611363.118286, 'auction_closing_time': 1774716057.0}
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU79691') HTTP/1.1" 204 0
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da41590>
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_4113b638260c0adca08685fe200b6e8e.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_4113b638260c0adca08685fe200b6e8e.jpg saved to cache
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf22150>
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_14fcad42f538e7f8ce2e352393c2395e.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_14fcad42f538e7f8ce2e352393c2395e.jpg saved to cache
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_1f04131a3073cbe144f5309e6fb2ea23.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ff8c4d0>
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F89%252Fa689f8382b5098f71ad5431217f4d3af%252Fpa%252FMP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg saved to cache
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7
2026-03-27 11:36:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7, skipping ID generation
2026-03-27 11:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with scrape type 1
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 sending to next pipeline
2026-03-27 11:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7, identifier: MP28046
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fab7610>
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fcc%252F6fccc54372c262bdd5fccd8c5b05d51b%252Fpa%252FBB40778_182e4677545b2f8330d212b632acac4c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_182e4677545b2f8330d212b632acac4c.jpg saved to cache
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1
2026-03-27 11:36:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76258935-be0a-58f6-b7dd-814fc3f8f5d1, skipping ID generation
2026-03-27 11:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with scrape type 1
2026-03-27 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76258935-be0a-58f6-b7dd-814fc3f8f5d1 sending to next pipeline
2026-03-27 11:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76258935-be0a-58f6-b7dd-814fc3f8f5d1, identifier: BB40778
2026-03-27 11:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-27 11:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046
2026-03-27 11:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0eaaa256-18a7-52b9-ac7a-89014d3a4cb7 with identifier: MP28046 to the API
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:34:20Z',
 'fuel_type': 'petrol',
 'id': '0eaaa256-18a7-52b9-ac7a-89014d3a4cb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP28046',
 'listing': 'auction',
 'location': 'BE, Strépy Bracquegnies (La Louviere)',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 76109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_f2b0f2f9b42f957b6c45da206c36c8eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_14fcad42f538e7f8ce2e352393c2395e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2d8d2ce68d2297f77f2d21e91e547726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_e3a197896e108d8ccc7ed377c617cda2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3104839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a4606bcd13e6114aeb2f667942316662.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_bf7dd486496a2a0456dfbe27cf05413a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_2e7b170f2f6af54315c1d6ae161ae787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_a2730f38cb773509e5b51e4694ced356.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7a6e0fbfdb5e999ca71db1c71560dae3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0eaaa256-18a7-52b9-ac7a-89014d3a4cb7/0eaaa256-18a7-52b9-ac7a-89014d3a4cb7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/89/a689f8382b5098f71ad5431217f4d3af/pa/MP28046_7d0f86db70848c7dfe1cccf47bba0563.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'automatic',
 'trim': 'Satellite',
 'year': 2011}
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-27 11:36:03 [auto1.be] INFO: Saving data for MP28046: {'created_time': 1774611363.885903, 'last_price_update_time': 1774611363.885915, 'auction_closing_time': 1774715660.0}
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MP28046') HTTP/1.1" 204 0
2026-03-27 11:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-27 11:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778
2026-03-27 11:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76258935-be0a-58f6-b7dd-814fc3f8f5d1 with identifier: BB40778 to the API
2026-03-27 11:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_182e4677545b2f8330d212b632acac4c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:38:52Z',
 'fuel_type': 'petrol',
 'id': '76258935-be0a-58f6-b7dd-814fc3f8f5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB40778',
 'listing': 'auction',
 'location': 'BE, Oostakker',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 174725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_2e7939996c97b384c313fba1c407f4b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_334d4d08b4f1c9cdecd789afa5efd3eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_96ee2683c000fd257455f47aeb71824c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_9cf272396fd80d90b4e9ef902fbac2a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_ec6290d67e6182e5a5987b90c14df0da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76258935-be0a-58f6-b7dd-814fc3f8f5d1/76258935-be0a-58f6-b7dd-814fc3f8f5d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/cc/6fccc54372c262bdd5fccd8c5b05d51b/pa/BB40778_182e4677545b2f8330d212b632acac4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-27 11:36:04 [auto1.be] INFO: Saving data for BB40778: {'created_time': 1774611364.225911, 'last_price_update_time': 1774611364.225923, 'auction_closing_time': 1774715932.0}
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB40778') HTTP/1.1" 204 0
2026-03-27 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH61674> (referer: https://www.auto1.com/v1/car-details-view/RH61674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK79502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:04 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1870 | hits on page: 40
2026-03-27 11:36:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db93d10>
2026-03-27 11:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_1f04131a3073cbe144f5309e6fb2ea23.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_1f04131a3073cbe144f5309e6fb2ea23.jpg saved to cache
2026-03-27 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-27 11:36:04 [auto1.be] INFO: Scrape type for VM12927: 2
2026-03-27 11:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-27 11:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with scrape type 2
2026-03-27 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with scrape type 2
2026-03-27 11:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b77ff12a-c863-558f-a8b3-18a5a93cc3c5, identifier: VM12927
2026-03-27 11:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-27 11:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927
2026-03-27 11:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b77ff12a-c863-558f-a8b3-18a5a93cc3c5 with identifier: VM12927 to the API
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:56:49Z',
 'fuel_type': 'hybrid',
 'id': 'b77ff12a-c863-558f-a8b3-18a5a93cc3c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM12927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 258698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-27 11:36:04 [auto1.be] INFO: Saving data for VM12927: {'auction_closing_time': 1774717009.0, 'created_time': 1773780048.69132, 'last_price_update_time': 1774611364.858494}
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM12927') HTTP/1.1" 204 0
2026-03-27 11:36:04 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-27 11:36:04 [auto1.be] INFO: Scrape type for TM97404: 2
2026-03-27 11:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-27 11:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with scrape type 2
2026-03-27 11:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with scrape type 2
2026-03-27 11:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2, identifier: TM97404
2026-03-27 11:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-27 11:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404
2026-03-27 11:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f0e0f58-7dbf-506b-b74a-e2d3445dacf2 with identifier: TM97404 to the API
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:16:34Z',
 'fuel_type': 'diesel',
 'id': '0f0e0f58-7dbf-506b-b74a-e2d3445dacf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM97404',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 246819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [auto1.be] INFO: Saving data for TM97404: {'auction_closing_time': 1774714594.0, 'created_time': 1773240294.153355, 'last_price_update_time': 1774611365.39136}
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM97404') HTTP/1.1" 204 0
2026-03-27 11:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1295ab-858d-5c92-8948-77c26f138fa5 with identifier: RH61674
2026-03-27 11:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1295ab-858d-5c92-8948-77c26f138fa5 with scrape type 1
2026-03-27 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_6509961c7001fc7f34d74f43f17b0216.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_6509961c7001fc7f34d74f43f17b0216.jpg not downloaded yet
2026-03-27 11:36:05 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [auto1.be] INFO: Scrape type for CB60498: 1
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_dbd3a0429217c7430b6507a5cc281f71.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_dbd3a0429217c7430b6507a5cc281f71.jpg not downloaded yet
2026-03-27 11:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:05 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-27 11:36:05 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [auto1.be] INFO: Scrape type for VE52917: 2
2026-03-27 11:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-27 11:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with scrape type 2
2026-03-27 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with scrape type 2
2026-03-27 11:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15ea9686-0119-52b0-8be3-4e94efd1c0e1, identifier: VE52917
2026-03-27 11:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_0b29ade3ccce74535eb96a1016119904.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-27 11:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917
2026-03-27 11:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15ea9686-0119-52b0-8be3-4e94efd1c0e1 with identifier: VE52917 to the API
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:27:00Z',
 'fuel_type': 'diesel',
 'id': '15ea9686-0119-52b0-8be3-4e94efd1c0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE52917',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 206189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [auto1.be] INFO: Saving data for VE52917: {'auction_closing_time': 1774715220.0, 'created_time': 1773693578.098352, 'last_price_update_time': 1774611365.905207}
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE52917') HTTP/1.1" 204 0
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_726759512c407f747d8a3c77edb3102f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_726759512c407f747d8a3c77edb3102f.jpg not downloaded yet
2026-03-27 11:36:05 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-27 11:36:05 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-27 11:36:05 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-27 11:36:05 [auto1.be] INFO: Scrape type for YF28674: 2
2026-03-27 11:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-27 11:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dbd15a-1c73-5853-ab10-b6e315cb2479 with scrape type 2
2026-03-27 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45dbd15a-1c73-5853-ab10-b6e315cb2479 with scrape type 2
2026-03-27 11:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45dbd15a-1c73-5853-ab10-b6e315cb2479, identifier: YF28674
2026-03-27 11:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-27 11:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674
2026-03-27 11:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45dbd15a-1c73-5853-ab10-b6e315cb2479 with identifier: YF28674 to the API
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:13Z',
 'fuel_type': 'petrol',
 'id': '45dbd15a-1c73-5853-ab10-b6e315cb2479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF28674',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 19883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-27 11:36:06 [auto1.be] INFO: Saving data for YF28674: {'auction_closing_time': 1774715113.0, 'created_time': 1774298191.047787, 'last_price_update_time': 1774611366.483358}
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF28674') HTTP/1.1" 204 0
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_b732932a33509b3c4544b5774d327ac8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b732932a33509b3c4544b5774d327ac8.jpg not downloaded yet
2026-03-27 11:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_6509961c7001fc7f34d74f43f17b0216.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:06 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-27 11:36:06 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-27 11:36:06 [auto1.be] INFO: Scrape type for XH49609: 2
2026-03-27 11:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-27 11:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec243356-4b5e-56a2-872a-716191b3a987 with scrape type 2
2026-03-27 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec243356-4b5e-56a2-872a-716191b3a987 with scrape type 2
2026-03-27 11:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec243356-4b5e-56a2-872a-716191b3a987, identifier: XH49609
2026-03-27 11:36:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ceabd10>
2026-03-27 11:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4c%252Ff64ce1a40d8ead76eb2797bd042cbe63%252Fpa%252FRH07818_0b29ade3ccce74535eb96a1016119904.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_0b29ade3ccce74535eb96a1016119904.jpg saved to cache
2026-03-27 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dcc4989-0149-5316-9c9a-6d939d6638d9
2026-03-27 11:36:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dcc4989-0149-5316-9c9a-6d939d6638d9, skipping ID generation
2026-03-27 11:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 with scrape type 1
2026-03-27 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dcc4989-0149-5316-9c9a-6d939d6638d9 sending to next pipeline
2026-03-27 11:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7dcc4989-0149-5316-9c9a-6d939d6638d9, identifier: RH07818
2026-03-27 11:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-27 11:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609
2026-03-27 11:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec243356-4b5e-56a2-872a-716191b3a987 with identifier: XH49609 to the API
2026-03-27 11:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:11:57Z',
 'fuel_type': 'diesel',
 'id': 'ec243356-4b5e-56a2-872a-716191b3a987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH49609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'BMW 1er 114d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-27 11:36:07 [auto1.be] INFO: Saving data for XH49609: {'auction_closing_time': 1774714317.0, 'created_time': 1773238225.544476, 'last_price_update_time': 1774611367.261357}
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH49609') HTTP/1.1" 204 0
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_b375b8bc11ed9fec6018ef288dbf2275.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b375b8bc11ed9fec6018ef288dbf2275.jpg not downloaded yet
2026-03-27 11:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-27 11:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818
2026-03-27 11:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7dcc4989-0149-5316-9c9a-6d939d6638d9 with identifier: RH07818 to the API
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_0b29ade3ccce74535eb96a1016119904.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:49Z',
 'fuel_type': 'petrol',
 'id': '7dcc4989-0149-5316-9c9a-6d939d6638d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH07818',
 'listing': 'auction',
 'location': 'BE, Vilvoorde',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 92665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_58273b8f4bef903b07fe79ce80c40b5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3106254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_75f40ce83fe0f3eeee4278878d59614d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2e55f8d4c01b7a3d193f7fe27cabee61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_c270dc9139e38c62e8d25d2e14aa3b64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3568375,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_0b29ade3ccce74535eb96a1016119904.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_bfabab3164ef9a4d06f438e2bc533a5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_2cdd0f72a8cd949514b2b596b9d596c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3070978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_1f04131a3073cbe144f5309e6fb2ea23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_af6845960c648929fa6f4c2b33de9587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dcc4989-0149-5316-9c9a-6d939d6638d9/7dcc4989-0149-5316-9c9a-6d939d6638d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3004353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/4c/f64ce1a40d8ead76eb2797bd042cbe63/pa/RH07818_e4792a9e0fba091fa9fb851aeb4aeda7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-27 11:36:07 [auto1.be] INFO: Saving data for RH07818: {'created_time': 1774611367.616486, 'last_price_update_time': 1774611367.616497, 'auction_closing_time': 1774716169.0}
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH07818') HTTP/1.1" 204 0
2026-03-27 11:36:07 [scrapy.extensions.logstats] INFO: Crawled 66 pages (at 66 pages/min), scraped 64 items (at 64 items/min)
2026-03-27 11:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 183MiB
2026-03-27 11:36:07 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-27 11:36:07 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-27 11:36:07 [auto1.be] INFO: Scrape type for BS55977: 2
2026-03-27 11:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-27 11:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with scrape type 2
2026-03-27 11:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with scrape type 2
2026-03-27 11:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d, identifier: BS55977
2026-03-27 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_dbd3a0429217c7430b6507a5cc281f71.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-27 11:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977
2026-03-27 11:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d with identifier: BS55977 to the API
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:24:21Z',
 'fuel_type': 'petrol',
 'id': 'f6fecaa9-9f74-5fda-a7a2-67f130ae0b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS55977',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 21978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-13',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2022}
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [auto1.be] INFO: Saving data for BS55977: {'auction_closing_time': 1774715061.0, 'created_time': 1773693669.341309, 'last_price_update_time': 1774611368.105377}
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS55977') HTTP/1.1" 204 0
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_954a5bd5d2450713786b43c4d115e865.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_954a5bd5d2450713786b43c4d115e865.jpg not downloaded yet
2026-03-27 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_726759512c407f747d8a3c77edb3102f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:08 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-27 11:36:08 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [auto1.be] INFO: Scrape type for BX96549: 2
2026-03-27 11:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-27 11:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9932f2-b2a2-5d1b-9377-395ab8386859 with scrape type 2
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9932f2-b2a2-5d1b-9377-395ab8386859 with scrape type 2
2026-03-27 11:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec9932f2-b2a2-5d1b-9377-395ab8386859, identifier: BX96549
2026-03-27 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cdd0850>
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_6509961c7001fc7f34d74f43f17b0216.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_6509961c7001fc7f34d74f43f17b0216.jpg saved to cache
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-27 11:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549
2026-03-27 11:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec9932f2-b2a2-5d1b-9377-395ab8386859 with identifier: BX96549 to the API
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:32Z',
 'fuel_type': 'diesel',
 'id': 'ec9932f2-b2a2-5d1b-9377-395ab8386859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX96549',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 224163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Advantage',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Advantage',
 'year': 2016}
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [auto1.be] INFO: Saving data for BX96549: {'auction_closing_time': 1774714712.0, 'created_time': 1773693532.930734, 'last_price_update_time': 1774611368.745028}
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX96549') HTTP/1.1" 204 0
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_88ebb0c2c673f3a9e2efac89b78f3c02.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_88ebb0c2c673f3a9e2efac89b78f3c02.jpg not downloaded yet
2026-03-27 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:08 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-27 11:36:08 [auto1.be] INFO: Scrape type for GJ23391: 2
2026-03-27 11:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-27 11:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85591b64-c2d3-5cb9-b784-f430dca1e622 with scrape type 2
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85591b64-c2d3-5cb9-b784-f430dca1e622 with scrape type 2
2026-03-27 11:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 85591b64-c2d3-5cb9-b784-f430dca1e622, identifier: GJ23391
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134f8f8f50>
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_dbd3a0429217c7430b6507a5cc281f71.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_dbd3a0429217c7430b6507a5cc281f71.jpg saved to cache
2026-03-27 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b732932a33509b3c4544b5774d327ac8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-27 11:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391
2026-03-27 11:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 85591b64-c2d3-5cb9-b784-f430dca1e622 with identifier: GJ23391 to the API
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:19Z',
 'fuel_type': 'diesel',
 'id': '85591b64-c2d3-5cb9-b784-f430dca1e622',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ23391',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 172410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.8 HDi Tendance 2WD',
 'transmission': 'manual',
 'trim': 'Tendance 2WD',
 'year': 2012}
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [auto1.be] INFO: Saving data for GJ23391: {'auction_closing_time': 1774715839.0, 'created_time': 1774298344.268251, 'last_price_update_time': 1774611369.239777}
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ23391') HTTP/1.1" 204 0
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_eeed82f236a3f1f8cd0721ff1a31a7cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_eeed82f236a3f1f8cd0721ff1a31a7cf.jpg not downloaded yet
2026-03-27 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b375b8bc11ed9fec6018ef288dbf2275.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:09 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [auto1.be] INFO: Scrape type for XH30316: 2
2026-03-27 11:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-27 11:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bee85060-27dd-5afa-b939-7b47d18b1efe with scrape type 2
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bee85060-27dd-5afa-b939-7b47d18b1efe with scrape type 2
2026-03-27 11:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bee85060-27dd-5afa-b939-7b47d18b1efe, identifier: XH30316
2026-03-27 11:36:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf4f710>
2026-03-27 11:36:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_726759512c407f747d8a3c77edb3102f.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_726759512c407f747d8a3c77edb3102f.jpg saved to cache
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:09 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1870 | hits on page: 40
2026-03-27 11:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-27 11:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316
2026-03-27 11:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bee85060-27dd-5afa-b939-7b47d18b1efe with identifier: XH30316 to the API
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:58Z',
 'fuel_type': 'diesel',
 'id': 'bee85060-27dd-5afa-b939-7b47d18b1efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH30316',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 199358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-03',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [auto1.be] INFO: Saving data for XH30316: {'auction_closing_time': 1774713778.0, 'created_time': 1774125442.068833, 'last_price_update_time': 1774611369.754899}
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH30316') HTTP/1.1" 204 0
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_cdec6d68173b5ef1d2f196f2800f52fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_cdec6d68173b5ef1d2f196f2800f52fc.jpg not downloaded yet
2026-03-27 11:36:09 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-27 11:36:09 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [auto1.be] INFO: Scrape type for KG87325: 2
2026-03-27 11:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-27 11:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with scrape type 2
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with scrape type 2
2026-03-27 11:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9aa4639-2eaf-5832-a89a-6c46f6cc5691, identifier: KG87325
2026-03-27 11:36:09 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-27 11:36:09 [auto1.be] INFO: Scrape type for UT04463: 2
2026-03-27 11:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-27 11:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab6c094-4925-54cd-a193-7a20a3b2c51d with scrape type 2
2026-03-27 11:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab6c094-4925-54cd-a193-7a20a3b2c51d with scrape type 2
2026-03-27 11:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ab6c094-4925-54cd-a193-7a20a3b2c51d, identifier: UT04463
2026-03-27 11:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK79502> (referer: https://www.auto1.com/v1/car-details-view/RK79502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d047410>
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fbb%252Fd7bb945af50c14e354bd9dcb6e2c043a%252Fpa%252FHL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg saved to cache
2026-03-27 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf025943-3ebe-55fe-af13-57de399c86c3
2026-03-27 11:36:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf025943-3ebe-55fe-af13-57de399c86c3, skipping ID generation
2026-03-27 11:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf025943-3ebe-55fe-af13-57de399c86c3 with scrape type 1
2026-03-27 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf025943-3ebe-55fe-af13-57de399c86c3 sending to next pipeline
2026-03-27 11:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf025943-3ebe-55fe-af13-57de399c86c3, identifier: HL14568
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d95bdd0>
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_b732932a33509b3c4544b5774d327ac8.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b732932a33509b3c4544b5774d327ac8.jpg saved to cache
2026-03-27 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_954a5bd5d2450713786b43c4d115e865.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-27 11:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325
2026-03-27 11:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9aa4639-2eaf-5832-a89a-6c46f6cc5691 with identifier: KG87325 to the API
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:00:05Z',
 'fuel_type': 'hybrid',
 'id': 'f9aa4639-2eaf-5832-a89a-6c46f6cc5691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG87325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 12326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-27 11:36:10 [auto1.be] INFO: Saving data for KG87325: {'auction_closing_time': 1774713605.0, 'created_time': 1773779734.955477, 'last_price_update_time': 1774611370.603777}
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG87325') HTTP/1.1" 204 0
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg not downloaded yet
2026-03-27 11:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-27 11:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463
2026-03-27 11:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ab6c094-4925-54cd-a193-7a20a3b2c51d with identifier: UT04463 to the API
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:16:20Z',
 'fuel_type': 'diesel',
 'id': '7ab6c094-4925-54cd-a193-7a20a3b2c51d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04463',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 210147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-27 11:36:10 [auto1.be] INFO: Saving data for UT04463: {'auction_closing_time': 1774714580.0, 'created_time': 1773866701.354523, 'last_price_update_time': 1774611370.976278}
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT04463') HTTP/1.1" 204 0
2026-03-27 11:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568
2026-03-27 11:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568
2026-03-27 11:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf025943-3ebe-55fe-af13-57de399c86c3 with identifier: HL14568 to the API
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'diesel',
 'id': 'cf025943-3ebe-55fe-af13-57de399c86c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL14568',
 'listing': 'auction',
 'location': 'BE, Bruxelles-Brussel',
 'make': 'BMW',
 'model': '5er',
 'odometer': 240071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_25fb7f00fa19f4c58c97ddbea87ba246.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_f42f6d5711a7502ea0883b2aec0bbfb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2500015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_2bb4fcbbbcb8af58008c1de92cde3856.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_6463e27c31681bf83601c31829827566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_0371c22d1c9d2a94f9b70ae4e5ee289d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_8fb542f42638662ea31a68f92fa2ba0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_615885b8751bf5e3a9d3d63ec65c7894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_29ae2189f3d0e61dd63c2f61f2c60c03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_ddda2956654e38aab5dff2355c47a43b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf025943-3ebe-55fe-af13-57de399c86c3/cf025943-3ebe-55fe-af13-57de399c86c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/bb/d7bb945af50c14e354bd9dcb6e2c043a/pa/HL14568_83c19c57bec4b0ab262a68bd15623d66.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL14568%27 HTTP/1.1" 200 None
2026-03-27 11:36:11 [auto1.be] INFO: Saving data for HL14568: {'created_time': 1774611371.357133, 'last_price_update_time': 1774611371.357145, 'auction_closing_time': 1774715902.0}
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL14568') HTTP/1.1" 204 0
2026-03-27 11:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_88ebb0c2c673f3a9e2efac89b78f3c02.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:11 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-27 11:36:11 [auto1.be] INFO: Scrape type for EL84394: 2
2026-03-27 11:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-27 11:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with scrape type 2
2026-03-27 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with scrape type 2
2026-03-27 11:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8, identifier: EL84394
2026-03-27 11:36:11 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-27 11:36:11 [auto1.be] INFO: Scrape type for BJ27729: 2
2026-03-27 11:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-27 11:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de489c1d-4dfa-5d64-b378-4f9773c807f9 with scrape type 2
2026-03-27 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de489c1d-4dfa-5d64-b378-4f9773c807f9 with scrape type 2
2026-03-27 11:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de489c1d-4dfa-5d64-b378-4f9773c807f9, identifier: BJ27729
2026-03-27 11:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fab51d0>
2026-03-27 11:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_b375b8bc11ed9fec6018ef288dbf2275.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b375b8bc11ed9fec6018ef288dbf2275.jpg saved to cache
2026-03-27 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-27 11:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394
2026-03-27 11:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6af9df9e-805c-593d-b9c7-94b4a8aff7d8 with identifier: EL84394 to the API
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:55:30Z',
 'fuel_type': 'diesel',
 'id': '6af9df9e-805c-593d-b9c7-94b4a8aff7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL84394',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 203556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-13',
 'seller_name': None,
 'title': 'BMW 1er 116d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2012}
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-27 11:36:11 [auto1.be] INFO: Saving data for EL84394: {'auction_closing_time': 1774716930.0, 'created_time': 1774298369.62793, 'last_price_update_time': 1774611371.976727}
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL84394') HTTP/1.1" 204 0
2026-03-27 11:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-27 11:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729
2026-03-27 11:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de489c1d-4dfa-5d64-b378-4f9773c807f9 with identifier: BJ27729 to the API
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:26Z',
 'fuel_type': 'petrol',
 'id': 'de489c1d-4dfa-5d64-b378-4f9773c807f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ27729',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 10113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-08-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-27 11:36:12 [auto1.be] INFO: Saving data for BJ27729: {'auction_closing_time': 1774716386.0, 'created_time': 1773866678.747124, 'last_price_update_time': 1774611372.28975}
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ27729') HTTP/1.1" 204 0
2026-03-27 11:36:12 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-27 11:36:12 [auto1.be] INFO: Scrape type for PB96026: 2
2026-03-27 11:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-27 11:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b91f928b-f874-5089-9023-8a78fc38d4f1 with scrape type 2
2026-03-27 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b91f928b-f874-5089-9023-8a78fc38d4f1 with scrape type 2
2026-03-27 11:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b91f928b-f874-5089-9023-8a78fc38d4f1, identifier: PB96026
2026-03-27 11:36:12 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-27 11:36:12 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-27 11:36:12 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-27 11:36:12 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-27 11:36:12 [auto1.be] INFO: Scrape type for GC03502: 2
2026-03-27 11:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-27 11:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with scrape type 2
2026-03-27 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with scrape type 2
2026-03-27 11:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3, identifier: GC03502
2026-03-27 11:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-27 11:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0d9d002-654d-51b1-a14f-04cb76d69395 with scrape type 1
2026-03-27 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_7cb581f658700cc48c6d85883fa6d848.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_7cb581f658700cc48c6d85883fa6d848.jpg not downloaded yet
2026-03-27 11:36:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db65950>
2026-03-27 11:36:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_954a5bd5d2450713786b43c4d115e865.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_954a5bd5d2450713786b43c4d115e865.jpg saved to cache
2026-03-27 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_eeed82f236a3f1f8cd0721ff1a31a7cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-27 11:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026
2026-03-27 11:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b91f928b-f874-5089-9023-8a78fc38d4f1 with identifier: PB96026 to the API
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:41Z',
 'fuel_type': 'diesel',
 'id': 'b91f928b-f874-5089-9023-8a78fc38d4f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB96026',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 149525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-12',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-27 11:36:13 [auto1.be] INFO: Saving data for PB96026: {'auction_closing_time': 1774715501.0, 'created_time': 1773693513.849546, 'last_price_update_time': 1774611373.08929}
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB96026') HTTP/1.1" 204 0
2026-03-27 11:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-27 11:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502
2026-03-27 11:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 123cbe69-4dfe-5185-bfd3-9ada7de4c9b3 with identifier: GC03502 to the API
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:26:47Z',
 'fuel_type': 'petrol',
 'id': '123cbe69-4dfe-5185-bfd3-9ada7de4c9b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC03502',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 154692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-27 11:36:13 [auto1.be] INFO: Saving data for GC03502: {'auction_closing_time': 1774715207.0, 'created_time': 1773131891.522737, 'last_price_update_time': 1774611373.511357}
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GC03502') HTTP/1.1" 204 0
2026-03-27 11:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_cdec6d68173b5ef1d2f196f2800f52fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:13 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-27 11:36:13 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-27 11:36:13 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-27 11:36:13 [auto1.be] INFO: Scrape type for RA81540: 2
2026-03-27 11:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-27 11:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b72f69-60b5-5888-aa23-9f9a474ddc4d with scrape type 2
2026-03-27 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b72f69-60b5-5888-aa23-9f9a474ddc4d with scrape type 2
2026-03-27 11:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15b72f69-60b5-5888-aa23-9f9a474ddc4d, identifier: RA81540
2026-03-27 11:36:13 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-27 11:36:13 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-27 11:36:13 [auto1.be] INFO: Scrape type for FC28385: 2
2026-03-27 11:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-27 11:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e066583-a6d5-54c4-9ace-e3e906348de6 with scrape type 2
2026-03-27 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e066583-a6d5-54c4-9ace-e3e906348de6 with scrape type 2
2026-03-27 11:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e066583-a6d5-54c4-9ace-e3e906348de6, identifier: FC28385
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_c6b960742ac17e79e0d117b443ad27e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_c6b960742ac17e79e0d117b443ad27e5.jpg not downloaded yet
2026-03-27 11:36:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db28750>
2026-03-27 11:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a73d38193016a3c98d71d0d5a5dc1%252Fpa%252FTU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg saved to cache
2026-03-27 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 264d6f6f-4cd5-516c-b999-a468d4bea33b
2026-03-27 11:36:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 264d6f6f-4cd5-516c-b999-a468d4bea33b, skipping ID generation
2026-03-27 11:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 264d6f6f-4cd5-516c-b999-a468d4bea33b with scrape type 1
2026-03-27 11:36:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 264d6f6f-4cd5-516c-b999-a468d4bea33b sending to next pipeline
2026-03-27 11:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 264d6f6f-4cd5-516c-b999-a468d4bea33b, identifier: TU68669
2026-03-27 11:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cea8150>
2026-03-27 11:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_88ebb0c2c673f3a9e2efac89b78f3c02.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_88ebb0c2c673f3a9e2efac89b78f3c02.jpg saved to cache
2026-03-27 11:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-27 11:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540
2026-03-27 11:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15b72f69-60b5-5888-aa23-9f9a474ddc4d with identifier: RA81540 to the API
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'petrol',
 'id': '15b72f69-60b5-5888-aa23-9f9a474ddc4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA81540',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 113473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line R&B',
 'transmission': 'manual',
 'trim': 'ST-Line R&B',
 'year': 2018}
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-27 11:36:14 [auto1.be] INFO: Saving data for RA81540: {'auction_closing_time': 1774715251.0, 'created_time': 1773240354.480115, 'last_price_update_time': 1774611374.385027}
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA81540') HTTP/1.1" 204 0
2026-03-27 11:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-27 11:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385
2026-03-27 11:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e066583-a6d5-54c4-9ace-e3e906348de6 with identifier: FC28385 to the API
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:26Z',
 'fuel_type': 'petrol',
 'id': '5e066583-a6d5-54c4-9ace-e3e906348de6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC28385',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 208965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-07',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-27 11:36:14 [auto1.be] INFO: Saving data for FC28385: {'auction_closing_time': 1774713866.0, 'created_time': 1773134409.180453, 'last_price_update_time': 1774611374.693619}
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC28385') HTTP/1.1" 204 0
2026-03-27 11:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-27 11:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669
2026-03-27 11:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 264d6f6f-4cd5-516c-b999-a468d4bea33b with identifier: TU68669 to the API
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:26Z',
 'fuel_type': 'diesel',
 'id': '264d6f6f-4cd5-516c-b999-a468d4bea33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU68669',
 'listing': 'auction',
 'location': 'BE, Mechelen',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 157938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_4113b638260c0adca08685fe200b6e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579102,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_f3cdacdb3dce4cbe0c0309b54a044c95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_7698cd3df003bd4dc45f833610b679f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_365828aebbc85e89ab6626551e3d0a46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_3a852833235fb269ce8d50e18c6ce2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_fda6e993068fc3afeb0663d0f6f57b63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_21c24cfc6a5a862a928afeb7086dde55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_26180449c57c36e1c340f8d85a9b6818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_6aabc0c6209517ed15cb7e2052570233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_264d6f6f-4cd5-516c-b999-a468d4bea33b/264d6f6f-4cd5-516c-b999-a468d4bea33b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a73d38193016a3c98d71d0d5a5dc1/pa/TU68669_2c6a412975d2d51b02b287ecc2a0e3e8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction ultra',
 'transmission': 'manual',
 'trim': 'Attraction ultra',
 'year': 2015}
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Saving data for TU68669: {'created_time': 1774611375.0683, 'last_price_update_time': 1774611375.068312, 'auction_closing_time': 1774716206.0}
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU68669') HTTP/1.1" 204 0
2026-03-27 11:36:15 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-27 11:36:15 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Scrape type for FV97066: 2
2026-03-27 11:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-27 11:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with scrape type 2
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with scrape type 2
2026-03-27 11:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a, identifier: FV97066
2026-03-27 11:36:15 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Scrape type for MD39375: 1
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_24f7f764ef786da38471da3d6e48fe54.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_24f7f764ef786da38471da3d6e48fe54.jpg not downloaded yet
2026-03-27 11:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-27 11:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066
2026-03-27 11:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd805b55-1afb-5b07-be74-9ab9ca9b2d2a with identifier: FV97066 to the API
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:43Z',
 'fuel_type': 'diesel',
 'id': 'fd805b55-1afb-5b07-be74-9ab9ca9b2d2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV97066',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 127856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-15',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Saving data for FV97066: {'auction_closing_time': 1774716103.0, 'created_time': 1773866726.442018, 'last_price_update_time': 1774611375.562352}
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV97066') HTTP/1.1" 204 0
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce0b850>
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_eeed82f236a3f1f8cd0721ff1a31a7cf.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_eeed82f236a3f1f8cd0721ff1a31a7cf.jpg saved to cache
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db7f510>
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_cdec6d68173b5ef1d2f196f2800f52fc.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_cdec6d68173b5ef1d2f196f2800f52fc.jpg saved to cache
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_7cb581f658700cc48c6d85883fa6d848.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:15 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Scrape type for NC04706: 2
2026-03-27 11:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-27 11:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with scrape type 2
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with scrape type 2
2026-03-27 11:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c, identifier: NC04706
2026-03-27 11:36:15 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [auto1.be] INFO: Scrape type for ZJ33794: 2
2026-03-27 11:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-27 11:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with scrape type 2
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with scrape type 2
2026-03-27 11:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b774dfc-948d-53b0-a1a1-a400d054a6c0, identifier: ZJ33794
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_776c37469555df0a6727ae03d61c9bc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_776c37469555df0a6727ae03d61c9bc8.jpg not downloaded yet
2026-03-27 11:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-27 11:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706
2026-03-27 11:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1a8552fe-0a7c-5d45-81b2-892f66bfb54c with identifier: NC04706 to the API
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:16Z',
 'fuel_type': 'petrol',
 'id': '1a8552fe-0a7c-5d45-81b2-892f66bfb54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC04706',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 123913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-27 11:36:16 [auto1.be] INFO: Saving data for NC04706: {'auction_closing_time': 1774716136.0, 'created_time': 1774298376.631374, 'last_price_update_time': 1774611376.236643}
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC04706') HTTP/1.1" 204 0
2026-03-27 11:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-27 11:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794
2026-03-27 11:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b774dfc-948d-53b0-a1a1-a400d054a6c0 with identifier: ZJ33794 to the API
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:32:41Z',
 'fuel_type': 'diesel',
 'id': '6b774dfc-948d-53b0-a1a1-a400d054a6c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ33794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 142264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-27 11:36:16 [auto1.be] INFO: Saving data for ZJ33794: {'auction_closing_time': 1774715561.0, 'created_time': 1773238108.059606, 'last_price_update_time': 1774611376.590992}
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ33794') HTTP/1.1" 204 0
2026-03-27 11:36:16 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-27 11:36:16 [auto1.be] INFO: Scrape type for LU38585: 2
2026-03-27 11:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-27 11:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466d7955-e321-5c6f-9a00-6c3bbb48a33e with scrape type 2
2026-03-27 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466d7955-e321-5c6f-9a00-6c3bbb48a33e with scrape type 2
2026-03-27 11:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 466d7955-e321-5c6f-9a00-6c3bbb48a33e, identifier: LU38585
2026-03-27 11:36:16 [auto1.be] INFO: Found listing with ID: UZ15252
2026-03-27 11:36:16 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-27 11:36:16 [auto1.be] INFO: Scrape type for KF50538: 2
2026-03-27 11:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-27 11:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with scrape type 2
2026-03-27 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with scrape type 2
2026-03-27 11:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6733d0f4-f06a-58a8-8654-5ebeee483ee0, identifier: KF50538
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_e772a9c263be852dfd9ba2799636382f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_e772a9c263be852dfd9ba2799636382f.jpg not downloaded yet
2026-03-27 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_c6b960742ac17e79e0d117b443ad27e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-27 11:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585
2026-03-27 11:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 466d7955-e321-5c6f-9a00-6c3bbb48a33e with identifier: LU38585 to the API
2026-03-27 11:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:38Z',
 'fuel_type': 'petrol',
 'id': '466d7955-e321-5c6f-9a00-6c3bbb48a33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU38585',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-27 11:36:17 [auto1.be] INFO: Saving data for LU38585: {'auction_closing_time': 1774715858.0, 'created_time': 1773736534.981773, 'last_price_update_time': 1774611377.176904}
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LU38585') HTTP/1.1" 204 0
2026-03-27 11:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-27 11:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538
2026-03-27 11:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6733d0f4-f06a-58a8-8654-5ebeee483ee0 with identifier: KF50538 to the API
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:06Z',
 'fuel_type': 'diesel',
 'id': '6733d0f4-f06a-58a8-8654-5ebeee483ee0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF50538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 145675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-27 11:36:17 [auto1.be] INFO: Saving data for KF50538: {'auction_closing_time': 1774714686.0, 'created_time': 1773240138.017526, 'last_price_update_time': 1774611377.60119}
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF50538') HTTP/1.1" 204 0
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf7dd0>
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_7cb581f658700cc48c6d85883fa6d848.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_7cb581f658700cc48c6d85883fa6d848.jpg saved to cache
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134db28e10>
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F95%252Fac95e0e3c992fc428b3661f6dd0d108f%252Fpa%252FRH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg saved to cache
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a1295ab-858d-5c92-8948-77c26f138fa5
2026-03-27 11:36:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a1295ab-858d-5c92-8948-77c26f138fa5, skipping ID generation
2026-03-27 11:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1295ab-858d-5c92-8948-77c26f138fa5 with scrape type 1
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a1295ab-858d-5c92-8948-77c26f138fa5 sending to next pipeline
2026-03-27 11:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a1295ab-858d-5c92-8948-77c26f138fa5, identifier: RH61674
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-27 11:36:17 [auto1.be] INFO: Scrape type for ZD51863: 2
2026-03-27 11:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863
2026-03-27 11:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8714701-4a86-58f7-97e7-d7056e4a0963 with scrape type 2
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8714701-4a86-58f7-97e7-d7056e4a0963 with scrape type 2
2026-03-27 11:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8714701-4a86-58f7-97e7-d7056e4a0963, identifier: ZD51863
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-27 11:36:17 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-27 11:36:17 [auto1.be] INFO: Scrape type for PM96543: 2
2026-03-27 11:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-27 11:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3094276f-f50f-5560-840c-9715111c4757 with scrape type 2
2026-03-27 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3094276f-f50f-5560-840c-9715111c4757 with scrape type 2
2026-03-27 11:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3094276f-f50f-5560-840c-9715111c4757, identifier: PM96543
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_9e81a54865927adaacede1b0307e24d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_9e81a54865927adaacede1b0307e24d6.jpg not downloaded yet
2026-03-27 11:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a1295ab-858d-5c92-8948-77c26f138fa5 with identifier: RH61674
2026-03-27 11:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a1295ab-858d-5c92-8948-77c26f138fa5 with identifier: RH61674
2026-03-27 11:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a1295ab-858d-5c92-8948-77c26f138fa5 with identifier: RH61674 to the API
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:09:00Z',
 'fuel_type': 'diesel',
 'id': '7a1295ab-858d-5c92-8948-77c26f138fa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH61674',
 'listing': 'auction',
 'location': 'BE, Herentals',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 168199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_6509961c7001fc7f34d74f43f17b0216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_dbd3a0429217c7430b6507a5cc281f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_726759512c407f747d8a3c77edb3102f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b732932a33509b3c4544b5774d327ac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_b375b8bc11ed9fec6018ef288dbf2275.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_954a5bd5d2450713786b43c4d115e865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_88ebb0c2c673f3a9e2efac89b78f3c02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_eeed82f236a3f1f8cd0721ff1a31a7cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_cdec6d68173b5ef1d2f196f2800f52fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1295ab-858d-5c92-8948-77c26f138fa5/7a1295ab-858d-5c92-8948-77c26f138fa5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/95/ac95e0e3c992fc428b3661f6dd0d108f/pa/RH61674_fa44f149bccd812e67c6ed4e4a35e460.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH61674%27 HTTP/1.1" 200 None
2026-03-27 11:36:18 [auto1.be] INFO: Saving data for RH61674: {'created_time': 1774611378.562541, 'last_price_update_time': 1774611378.562556, 'auction_closing_time': 1774714140.0}
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH61674') HTTP/1.1" 204 0
2026-03-27 11:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863
2026-03-27 11:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863
2026-03-27 11:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8714701-4a86-58f7-97e7-d7056e4a0963 with identifier: ZD51863 to the API
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:01:28Z',
 'fuel_type': 'diesel',
 'id': 'a8714701-4a86-58f7-97e7-d7056e4a0963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD51863',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 276980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-19',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline',
 'year': 2012}
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD51863%27 HTTP/1.1" 200 None
2026-03-27 11:36:18 [auto1.be] INFO: Saving data for ZD51863: {'auction_closing_time': 1774713688.0, 'created_time': 1774298293.941346, 'last_price_update_time': 1774611378.883018}
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD51863') HTTP/1.1" 204 0
2026-03-27 11:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-27 11:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543
2026-03-27 11:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3094276f-f50f-5560-840c-9715111c4757 with identifier: PM96543 to the API
2026-03-27 11:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:17:08Z',
 'fuel_type': 'petrol',
 'id': '3094276f-f50f-5560-840c-9715111c4757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM96543',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 121557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2021}
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-27 11:36:19 [auto1.be] INFO: Saving data for PM96543: {'auction_closing_time': 1774714628.0, 'created_time': 1773132475.845034, 'last_price_update_time': 1774611379.204833}
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM96543') HTTP/1.1" 204 0
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-27 11:36:19 [auto1.be] INFO: Scrape type for KF81819: 2
2026-03-27 11:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-27 11:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62194af-a766-5e06-b7d1-4d103857dd73 with scrape type 2
2026-03-27 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62194af-a766-5e06-b7d1-4d103857dd73 with scrape type 2
2026-03-27 11:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c62194af-a766-5e06-b7d1-4d103857dd73, identifier: KF81819
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_8b6d96c61669ac38aeab7152007105e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_8b6d96c61669ac38aeab7152007105e8.jpg not downloaded yet
2026-03-27 11:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-27 11:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819
2026-03-27 11:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c62194af-a766-5e06-b7d1-4d103857dd73 with identifier: KF81819 to the API
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-28T16:19:53Z',
 'fuel_type': 'petrol',
 'id': 'c62194af-a766-5e06-b7d1-4d103857dd73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF81819',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': '300 C',
 'odometer': 125165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-02',
 'seller_name': None,
 'title': 'Chrysler 300 C 2.7',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-27 11:36:19 [auto1.be] INFO: Saving data for KF81819: {'auction_closing_time': 1774714793.0, 'created_time': 1773301686.459703, 'last_price_update_time': 1774611379.717621}
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF81819') HTTP/1.1" 204 0
2026-03-27 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC46636> (referer: https://www.auto1.com/v1/car-details-view/LC46636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB60498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:19 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1870 | hits on page: 40
2026-03-27 11:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9b1350>
2026-03-27 11:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_c6b960742ac17e79e0d117b443ad27e5.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_c6b960742ac17e79e0d117b443ad27e5.jpg saved to cache
2026-03-27 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-27 11:36:19 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-27 11:36:19 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-27 11:36:19 [auto1.be] INFO: Scrape type for KP16038: 2
2026-03-27 11:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-27 11:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad01e60-ac17-529b-ab84-522576749a70 with scrape type 2
2026-03-27 11:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad01e60-ac17-529b-ab84-522576749a70 with scrape type 2
2026-03-27 11:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ad01e60-ac17-529b-ab84-522576749a70, identifier: KP16038
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_a56f3d44ddcb80e2fc5cac228a5004c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_a56f3d44ddcb80e2fc5cac228a5004c8.jpg not downloaded yet
2026-03-27 11:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_e772a9c263be852dfd9ba2799636382f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-27 11:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038
2026-03-27 11:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ad01e60-ac17-529b-ab84-522576749a70 with identifier: KP16038 to the API
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:58Z',
 'fuel_type': 'diesel',
 'id': '6ad01e60-ac17-529b-ab84-522576749a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 157350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-27 11:36:20 [auto1.be] INFO: Saving data for KP16038: {'auction_closing_time': 1774715038.0, 'created_time': 1773693559.723935, 'last_price_update_time': 1774611380.335348}
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP16038') HTTP/1.1" 204 0
2026-03-27 11:36:20 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-27 11:36:20 [auto1.be] INFO: Scrape type for KN88676: 2
2026-03-27 11:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-27 11:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35733f2-4263-517c-8003-1531b3a86137 with scrape type 2
2026-03-27 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35733f2-4263-517c-8003-1531b3a86137 with scrape type 2
2026-03-27 11:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b35733f2-4263-517c-8003-1531b3a86137, identifier: KN88676
2026-03-27 11:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_9e81a54865927adaacede1b0307e24d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:20 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-27 11:36:20 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-27 11:36:20 [auto1.be] INFO: Scrape type for PH64665: 2
2026-03-27 11:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-27 11:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be884f4-f70e-5d5b-8d2c-d41e539064fb with scrape type 2
2026-03-27 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be884f4-f70e-5d5b-8d2c-d41e539064fb with scrape type 2
2026-03-27 11:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9be884f4-f70e-5d5b-8d2c-d41e539064fb, identifier: PH64665
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_d94087cf2134bad3e1b260326a0e719c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d94087cf2134bad3e1b260326a0e719c.jpg not downloaded yet
2026-03-27 11:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-27 11:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676
2026-03-27 11:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b35733f2-4263-517c-8003-1531b3a86137 with identifier: KN88676 to the API
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:33:14Z',
 'fuel_type': 'diesel',
 'id': 'b35733f2-4263-517c-8003-1531b3a86137',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN88676',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 206887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2013}
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-27 11:36:20 [auto1.be] INFO: Saving data for KN88676: {'auction_closing_time': 1774715594.0, 'created_time': 1773136045.972491, 'last_price_update_time': 1774611380.892449}
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KN88676') HTTP/1.1" 204 0
2026-03-27 11:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-27 11:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665
2026-03-27 11:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9be884f4-f70e-5d5b-8d2c-d41e539064fb with identifier: PH64665 to the API
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'diesel',
 'id': '9be884f4-f70e-5d5b-8d2c-d41e539064fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH64665',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 277375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-04',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [auto1.be] INFO: Saving data for PH64665: {'auction_closing_time': 1774716172.0, 'created_time': 1773693510.93278, 'last_price_update_time': 1774611381.237131}
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH64665') HTTP/1.1" 204 0
2026-03-27 11:36:21 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [auto1.be] INFO: Scrape type for HW65369: 2
2026-03-27 11:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-27 11:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item babea493-d702-55d5-914b-4e328915b3d6 with scrape type 2
2026-03-27 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item babea493-d702-55d5-914b-4e328915b3d6 with scrape type 2
2026-03-27 11:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: babea493-d702-55d5-914b-4e328915b3d6, identifier: HW65369
2026-03-27 11:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-27 11:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254735c0-f192-5a60-ba4c-80af7ce6e950 with scrape type 1
2026-03-27 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_52f56922728d3cb90cabfd16bf58803d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_52f56922728d3cb90cabfd16bf58803d.jpg not downloaded yet
2026-03-27 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_8b6d96c61669ac38aeab7152007105e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:21 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-27 11:36:21 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-27 11:36:21 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [auto1.be] INFO: Scrape type for ZN66630: 1
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_d986b285871cef401e2a250b018e3ef6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d986b285871cef401e2a250b018e3ef6.jpg not downloaded yet
2026-03-27 11:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-27 11:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369
2026-03-27 11:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: babea493-d702-55d5-914b-4e328915b3d6 with identifier: HW65369 to the API
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:28:46Z',
 'fuel_type': 'hybrid',
 'id': 'babea493-d702-55d5-914b-4e328915b3d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW65369',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 77633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [auto1.be] INFO: Saving data for HW65369: {'auction_closing_time': 1774715326.0, 'created_time': 1773136838.383482, 'last_price_update_time': 1774611381.756103}
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW65369') HTTP/1.1" 204 0
2026-03-27 11:36:21 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-27 11:36:21 [auto1.be] INFO: Scrape type for UH14890: 2
2026-03-27 11:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-27 11:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 216895f9-3ae9-598d-b3cd-35726bb9190c with scrape type 2
2026-03-27 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 216895f9-3ae9-598d-b3cd-35726bb9190c with scrape type 2
2026-03-27 11:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 216895f9-3ae9-598d-b3cd-35726bb9190c, identifier: UH14890
2026-03-27 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_dc7c43e93464c41a4ddbe0fef1b934ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_dc7c43e93464c41a4ddbe0fef1b934ce.jpg not downloaded yet
2026-03-27 11:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8df410>
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_e772a9c263be852dfd9ba2799636382f.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_e772a9c263be852dfd9ba2799636382f.jpg saved to cache
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf4d3d0>
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_9e81a54865927adaacede1b0307e24d6.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_9e81a54865927adaacede1b0307e24d6.jpg saved to cache
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_a56f3d44ddcb80e2fc5cac228a5004c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:22 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-27 11:36:22 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-27 11:36:22 [auto1.be] INFO: Scrape type for GH94077: 2
2026-03-27 11:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-27 11:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with scrape type 2
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with scrape type 2
2026-03-27 11:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 273cc2a8-9f22-54ab-bed4-684f509ae1d4, identifier: GH94077
2026-03-27 11:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-27 11:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890
2026-03-27 11:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 216895f9-3ae9-598d-b3cd-35726bb9190c with identifier: UH14890 to the API
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:31:30Z',
 'fuel_type': 'petrol',
 'id': '216895f9-3ae9-598d-b3cd-35726bb9190c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14890',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 78304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-21',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-27 11:36:22 [auto1.be] INFO: Saving data for UH14890: {'auction_closing_time': 1774715490.0, 'created_time': 1773693525.425046, 'last_price_update_time': 1774611382.598231}
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UH14890') HTTP/1.1" 204 0
2026-03-27 11:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-27 11:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077
2026-03-27 11:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 273cc2a8-9f22-54ab-bed4-684f509ae1d4 with identifier: GH94077 to the API
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:37:48Z',
 'fuel_type': 'diesel',
 'id': '273cc2a8-9f22-54ab-bed4-684f509ae1d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH94077',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 224435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'BMW 3er 335d xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2015}
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-27 11:36:22 [auto1.be] INFO: Saving data for GH94077: {'auction_closing_time': 1774715868.0, 'created_time': 1773693526.746469, 'last_price_update_time': 1774611382.95603}
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH94077') HTTP/1.1" 204 0
2026-03-27 11:36:22 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-27 11:36:22 [auto1.be] INFO: Scrape type for SC73086: 2
2026-03-27 11:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-27 11:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b44c9a68-462c-59cc-842a-a42a634a4c4d with scrape type 2
2026-03-27 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b44c9a68-462c-59cc-842a-a42a634a4c4d with scrape type 2
2026-03-27 11:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b44c9a68-462c-59cc-842a-a42a634a4c4d, identifier: SC73086
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_082545dd647ab875727efdec3ecd8ae3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_082545dd647ab875727efdec3ecd8ae3.jpg not downloaded yet
2026-03-27 11:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9c9590>
2026-03-27 11:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_8b6d96c61669ac38aeab7152007105e8.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_8b6d96c61669ac38aeab7152007105e8.jpg saved to cache
2026-03-27 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:23 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-27 11:36:23 [auto1.be] INFO: Scrape type for SB45161: 2
2026-03-27 11:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-27 11:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with scrape type 2
2026-03-27 11:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with scrape type 2
2026-03-27 11:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6b4a665-3a4c-5f0f-aa51-c983852f4d46, identifier: SB45161
2026-03-27 11:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-27 11:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086
2026-03-27 11:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b44c9a68-462c-59cc-842a-a42a634a4c4d with identifier: SC73086 to the API
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:28Z',
 'fuel_type': 'petrol',
 'id': 'b44c9a68-462c-59cc-842a-a42a634a4c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC73086',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 136155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-19',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2014}
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-27 11:36:23 [auto1.be] INFO: Saving data for SC73086: {'auction_closing_time': 1774713928.0, 'created_time': 1774298364.450341, 'last_price_update_time': 1774611383.608167}
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC73086') HTTP/1.1" 204 0
2026-03-27 11:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-27 11:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161
2026-03-27 11:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6b4a665-3a4c-5f0f-aa51-c983852f4d46 with identifier: SB45161 to the API
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:25:17Z',
 'fuel_type': 'diesel',
 'id': 'c6b4a665-3a4c-5f0f-aa51-c983852f4d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB45161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 114238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d T 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': 'T 4Matic Exclusive',
 'year': 2018}
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-27 11:36:23 [auto1.be] INFO: Saving data for SB45161: {'auction_closing_time': 1774715117.0, 'created_time': 1773780008.614746, 'last_price_update_time': 1774611383.988397}
2026-03-27 11:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB45161') HTTP/1.1" 204 0
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [auto1.be] INFO: Scrape type for NY53837: 1
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_b02c18a9e2b9c1fb8187d56ba331f085.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_b02c18a9e2b9c1fb8187d56ba331f085.jpg not downloaded yet
2026-03-27 11:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccce090>
2026-03-27 11:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_a56f3d44ddcb80e2fc5cac228a5004c8.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_a56f3d44ddcb80e2fc5cac228a5004c8.jpg saved to cache
2026-03-27 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d986b285871cef401e2a250b018e3ef6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [auto1.be] INFO: Scrape type for BU90061: 2
2026-03-27 11:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-27 11:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c147655d-5598-5a29-851e-ac380e05905d with scrape type 2
2026-03-27 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c147655d-5598-5a29-851e-ac380e05905d with scrape type 2
2026-03-27 11:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c147655d-5598-5a29-851e-ac380e05905d, identifier: BU90061
2026-03-27 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD39375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-27 11:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061
2026-03-27 11:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c147655d-5598-5a29-851e-ac380e05905d with identifier: BU90061 to the API
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:33Z',
 'fuel_type': 'diesel',
 'id': 'c147655d-5598-5a29-851e-ac380e05905d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU90061',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 254780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [auto1.be] INFO: Saving data for BU90061: {'auction_closing_time': 1774714953.0, 'created_time': 1773238342.478019, 'last_price_update_time': 1774611384.56861}
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU90061') HTTP/1.1" 204 0
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [auto1.be] INFO: Scrape type for JA34397: 1
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_1620691f5f7feac8fbd3775652d4e879.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_1620691f5f7feac8fbd3775652d4e879.jpg not downloaded yet
2026-03-27 11:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_dc7c43e93464c41a4ddbe0fef1b934ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:24 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-27 11:36:24 [auto1.be] INFO: Scrape type for JJ10339: 2
2026-03-27 11:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-27 11:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81fff97d-7a98-5822-adca-eeab47b5c767 with scrape type 2
2026-03-27 11:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81fff97d-7a98-5822-adca-eeab47b5c767 with scrape type 2
2026-03-27 11:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81fff97d-7a98-5822-adca-eeab47b5c767, identifier: JJ10339
2026-03-27 11:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-27 11:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339
2026-03-27 11:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81fff97d-7a98-5822-adca-eeab47b5c767 with identifier: JJ10339 to the API
2026-03-27 11:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:41:57Z',
 'fuel_type': 'petrol',
 'id': '81fff97d-7a98-5822-adca-eeab47b5c767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ10339',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 52303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Suzuki SX4 1.4 BoosterJet Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2019}
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Saving data for JJ10339: {'auction_closing_time': 1774716117.0, 'created_time': 1773779728.658145, 'last_price_update_time': 1774611385.18073}
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ10339') HTTP/1.1" 204 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV40639%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for FV40639: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU84298%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for JU84298: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for BC23353: 0
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_ecd0211b2466ba2dbef7c4adb76deb71.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_ecd0211b2466ba2dbef7c4adb76deb71.jpg not downloaded yet
2026-03-27 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_082545dd647ab875727efdec3ecd8ae3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-27 11:36:25 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-27 11:36:25 [auto1.be] INFO: Scrape type for WG62431: 2
2026-03-27 11:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-27 11:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2958b0c5-2af7-5849-b74b-c3641fee5741 with scrape type 2
2026-03-27 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2958b0c5-2af7-5849-b74b-c3641fee5741 with scrape type 2
2026-03-27 11:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2958b0c5-2af7-5849-b74b-c3641fee5741, identifier: WG62431
2026-03-27 11:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf3d10>
2026-03-27 11:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_d986b285871cef401e2a250b018e3ef6.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d986b285871cef401e2a250b018e3ef6.jpg saved to cache
2026-03-27 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-27 11:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431
2026-03-27 11:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2958b0c5-2af7-5849-b74b-c3641fee5741 with identifier: WG62431 to the API
2026-03-27 11:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:35Z',
 'fuel_type': 'petrol',
 'id': '2958b0c5-2af7-5849-b74b-c3641fee5741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG62431',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 213486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-07',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Saving data for WG62431: {'auction_closing_time': 1774715915.0, 'created_time': 1774125510.73548, 'last_price_update_time': 1774611386.247817}
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG62431') HTTP/1.1" 204 0
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_849e97cf56b2901f63db16438df4ae05.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_849e97cf56b2901f63db16438df4ae05.jpg not downloaded yet
2026-03-27 11:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134e7ece10>
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_dc7c43e93464c41a4ddbe0fef1b934ce.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_dc7c43e93464c41a4ddbe0fef1b934ce.jpg saved to cache
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_e73a7a766f694cf6c3077b46905816ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_e73a7a766f694cf6c3077b46905816ec.jpg not downloaded yet
2026-03-27 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_b02c18a9e2b9c1fb8187d56ba331f085.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_1620691f5f7feac8fbd3775652d4e879.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB60498> (referer: https://www.auto1.com/v1/car-details-view/CB60498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN66630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:26 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ceddd10>
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_082545dd647ab875727efdec3ecd8ae3.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_082545dd647ab875727efdec3ecd8ae3.jpg saved to cache
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_53e2730f923ce731e8c69619924d6ff6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_53e2730f923ce731e8c69619924d6ff6.jpg not downloaded yet
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23353%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for BC23353: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF18972%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for JF18972: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA37935%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for YA37935: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ45584%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for JJ45584: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-27 11:36:26 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [auto1.be] INFO: Scrape type for AB98915: 2
2026-03-27 11:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-27 11:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b71501c-e35f-5284-9543-b5c40ad92f2c with scrape type 2
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b71501c-e35f-5284-9543-b5c40ad92f2c with scrape type 2
2026-03-27 11:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b71501c-e35f-5284-9543-b5c40ad92f2c, identifier: AB98915
2026-03-27 11:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_a7a18594d006697602a2c3ccc736c91d.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_a7a18594d006697602a2c3ccc736c91d.jpg not downloaded yet
2026-03-27 11:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-27 11:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915
2026-03-27 11:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b71501c-e35f-5284-9543-b5c40ad92f2c with identifier: AB98915 to the API
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:54:51Z',
 'fuel_type': 'diesel',
 'id': '4b71501c-e35f-5284-9543-b5c40ad92f2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB98915',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 144079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Origin',
 'transmission': 'manual',
 'trim': 'Origin',
 'year': 2014}
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-27 11:36:27 [auto1.be] INFO: Saving data for AB98915: {'auction_closing_time': 1774630491.0, 'created_time': 1774298302.753147, 'last_price_update_time': 1774611387.260633}
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB98915') HTTP/1.1" 204 0
2026-03-27 11:36:27 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-27 11:36:27 [auto1.be] INFO: Scrape type for XL09418: 2
2026-03-27 11:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-27 11:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with scrape type 2
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with scrape type 2
2026-03-27 11:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20d094a7-5388-5a8e-97d5-c729ff5bdc54, identifier: XL09418
2026-03-27 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_ecd0211b2466ba2dbef7c4adb76deb71.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_849e97cf56b2901f63db16438df4ae05.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-27 11:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418
2026-03-27 11:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20d094a7-5388-5a8e-97d5-c729ff5bdc54 with identifier: XL09418 to the API
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:08:45Z',
 'fuel_type': 'diesel',
 'id': '20d094a7-5388-5a8e-97d5-c729ff5bdc54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL09418',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 151368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L2H1 2,9t Authentique',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Authentique',
 'year': 2012}
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-27 11:36:27 [auto1.be] INFO: Saving data for XL09418: {'auction_closing_time': 1774627725.0, 'created_time': 1774298275.949361, 'last_price_update_time': 1774611387.79377}
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL09418') HTTP/1.1" 204 0
2026-03-27 11:36:27 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cedd350>
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_b02c18a9e2b9c1fb8187d56ba331f085.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_b02c18a9e2b9c1fb8187d56ba331f085.jpg saved to cache
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce5f550>
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_1620691f5f7feac8fbd3775652d4e879.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_1620691f5f7feac8fbd3775652d4e879.jpg saved to cache
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498
2026-03-27 11:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with scrape type 1
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_0e4633c55d6460f5120b6af03515929f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_0e4633c55d6460f5120b6af03515929f.jpg not downloaded yet
2026-03-27 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_e73a7a766f694cf6c3077b46905816ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_53e2730f923ce731e8c69619924d6ff6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_649f86fc8fad797ce2607a78fe352feb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_649f86fc8fad797ce2607a78fe352feb.jpg not downloaded yet
2026-03-27 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f76d0>
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_ecd0211b2466ba2dbef7c4adb76deb71.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_ecd0211b2466ba2dbef7c4adb76deb71.jpg saved to cache
2026-03-27 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d920350>
2026-03-27 11:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_849e97cf56b2901f63db16438df4ae05.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_849e97cf56b2901f63db16438df4ae05.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_3ddd17580882b607db5a71e4b6c33c1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_3ddd17580882b607db5a71e4b6c33c1b.jpg not downloaded yet
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d047810>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_e73a7a766f694cf6c3077b46905816ec.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_e73a7a766f694cf6c3077b46905816ec.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf4fc50>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_53e2730f923ce731e8c69619924d6ff6.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_53e2730f923ce731e8c69619924d6ff6.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_37400b2c0272a5249e1917f16f320777.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_37400b2c0272a5249e1917f16f320777.jpg not downloaded yet
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_0e4633c55d6460f5120b6af03515929f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY53837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_a7a18594d006697602a2c3ccc736c91d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_7729ada358cf115ba4882f7444237e8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_7729ada358cf115ba4882f7444237e8e.jpg not downloaded yet
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_24f7f764ef786da38471da3d6e48fe54.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_776c37469555df0a6727ae03d61c9bc8.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_b243a5084f2776ba5d2539435cad03f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b243a5084f2776ba5d2539435cad03f5.jpg not downloaded yet
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_d0baa5eff7dc3a2df7c675b677ce44d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d0baa5eff7dc3a2df7c675b677ce44d4.jpg not downloaded yet
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg not downloaded yet
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_517b977e01086a32f2ca44067eb00ac0.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_517b977e01086a32f2ca44067eb00ac0.jpg not downloaded yet
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_d204df11acdfe9f493726aea7367f019.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d204df11acdfe9f493726aea7367f019.jpg not downloaded yet
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf68890>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_0e4633c55d6460f5120b6af03515929f.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_0e4633c55d6460f5120b6af03515929f.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cfd7850>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_a7a18594d006697602a2c3ccc736c91d.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_a7a18594d006697602a2c3ccc736c91d.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da97c50>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_24f7f764ef786da38471da3d6e48fe54.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_24f7f764ef786da38471da3d6e48fe54.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf4c390>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_776c37469555df0a6727ae03d61c9bc8.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_776c37469555df0a6727ae03d61c9bc8.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d94087cf2134bad3e1b260326a0e719c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_649f86fc8fad797ce2607a78fe352feb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_3ddd17580882b607db5a71e4b6c33c1b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_7729ada358cf115ba4882f7444237e8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_37400b2c0272a5249e1917f16f320777.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_52f56922728d3cb90cabfd16bf58803d.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA34397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b243a5084f2776ba5d2539435cad03f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD39375> (referer: https://www.auto1.com/v1/car-details-view/MD39375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cccfc10>
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc4%252F21c4e67a5d4b65a589119d9bed9e8ba8%252Fpa%252FRK79502_d94087cf2134bad3e1b260326a0e719c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d94087cf2134bad3e1b260326a0e719c.jpg saved to cache
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0d9d002-654d-51b1-a14f-04cb76d69395
2026-03-27 11:36:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0d9d002-654d-51b1-a14f-04cb76d69395, skipping ID generation
2026-03-27 11:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0d9d002-654d-51b1-a14f-04cb76d69395 with scrape type 1
2026-03-27 11:36:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0d9d002-654d-51b1-a14f-04cb76d69395 sending to next pipeline
2026-03-27 11:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0d9d002-654d-51b1-a14f-04cb76d69395, identifier: RK79502
2026-03-27 11:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-27 11:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502
2026-03-27 11:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0d9d002-654d-51b1-a14f-04cb76d69395 with identifier: RK79502 to the API
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d94087cf2134bad3e1b260326a0e719c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:57:19Z',
 'fuel_type': 'petrol',
 'id': 'a0d9d002-654d-51b1-a14f-04cb76d69395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK79502',
 'listing': 'auction',
 'location': 'BE, Rochefort',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 60315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_7cb581f658700cc48c6d85883fa6d848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_c6b960742ac17e79e0d117b443ad27e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_24f7f764ef786da38471da3d6e48fe54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_776c37469555df0a6727ae03d61c9bc8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_e772a9c263be852dfd9ba2799636382f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_9e81a54865927adaacede1b0307e24d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_8b6d96c61669ac38aeab7152007105e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_a56f3d44ddcb80e2fc5cac228a5004c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2464168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d94087cf2134bad3e1b260326a0e719c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0d9d002-654d-51b1-a14f-04cb76d69395/a0d9d002-654d-51b1-a14f-04cb76d69395_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/c4/21c4e67a5d4b65a589119d9bed9e8ba8/pa/RK79502_d986b285871cef401e2a250b018e3ef6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-27 11:36:29 [auto1.be] INFO: Saving data for RK79502: {'created_time': 1774611389.445167, 'last_price_update_time': 1774611389.445179, 'auction_closing_time': 1774717039.0}
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK79502') HTTP/1.1" 204 0
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccccb50>
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_649f86fc8fad797ce2607a78fe352feb.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_649f86fc8fad797ce2607a78fe352feb.jpg saved to cache
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_517b977e01086a32f2ca44067eb00ac0.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d204df11acdfe9f493726aea7367f019.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN66630> (referer: https://www.auto1.com/v1/car-details-view/ZN66630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d98a850>
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_3ddd17580882b607db5a71e4b6c33c1b.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_3ddd17580882b607db5a71e4b6c33c1b.jpg saved to cache
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fd04710>
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_7729ada358cf115ba4882f7444237e8e.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_7729ada358cf115ba4882f7444237e8e.jpg saved to cache
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8c6610>
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_37400b2c0272a5249e1917f16f320777.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_37400b2c0272a5249e1917f16f320777.jpg saved to cache
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134dab3d50>
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Ff7%252Fedf7024764fbe18957d200bbef3f91be%252Fpa%252FLC46636_52f56922728d3cb90cabfd16bf58803d.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_52f56922728d3cb90cabfd16bf58803d.jpg saved to cache
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 254735c0-f192-5a60-ba4c-80af7ce6e950
2026-03-27 11:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 254735c0-f192-5a60-ba4c-80af7ce6e950, skipping ID generation
2026-03-27 11:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254735c0-f192-5a60-ba4c-80af7ce6e950 with scrape type 1
2026-03-27 11:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 254735c0-f192-5a60-ba4c-80af7ce6e950 sending to next pipeline
2026-03-27 11:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 254735c0-f192-5a60-ba4c-80af7ce6e950, identifier: LC46636
2026-03-27 11:36:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d046bd0>
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_b243a5084f2776ba5d2539435cad03f5.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b243a5084f2776ba5d2539435cad03f5.jpg saved to cache
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-27 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f213a5-7404-512c-bbab-565407f10070 with scrape type 1
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_235632387f6e837c3ceaa55211eb1991.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_235632387f6e837c3ceaa55211eb1991.jpg not downloaded yet
2026-03-27 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-27 11:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636
2026-03-27 11:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 254735c0-f192-5a60-ba4c-80af7ce6e950 with identifier: LC46636 to the API
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_52f56922728d3cb90cabfd16bf58803d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:05:50Z',
 'fuel_type': 'petrol',
 'id': '254735c0-f192-5a60-ba4c-80af7ce6e950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC46636',
 'listing': 'auction',
 'location': 'BE, Hasselt',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 97233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2614056,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_52f56922728d3cb90cabfd16bf58803d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_dc7c43e93464c41a4ddbe0fef1b934ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_082545dd647ab875727efdec3ecd8ae3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_b02c18a9e2b9c1fb8187d56ba331f085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_1620691f5f7feac8fbd3775652d4e879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_ecd0211b2466ba2dbef7c4adb76deb71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_849e97cf56b2901f63db16438df4ae05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_e73a7a766f694cf6c3077b46905816ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_53e2730f923ce731e8c69619924d6ff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_254735c0-f192-5a60-ba4c-80af7ce6e950/254735c0-f192-5a60-ba4c-80af7ce6e950_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/f7/edf7024764fbe18957d200bbef3f91be/pa/LC46636_a7a18594d006697602a2c3ccc736c91d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [auto1.be] INFO: Saving data for LC46636: {'created_time': 1774611390.43872, 'last_price_update_time': 1774611390.438733, 'auction_closing_time': 1774713950.0}
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LC46636') HTTP/1.1" 204 0
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_d89c2e25771f5924309300f5a0a5013f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_d89c2e25771f5924309300f5a0a5013f.jpg not downloaded yet
2026-03-27 11:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY53837> (referer: https://www.auto1.com/v1/car-details-view/NY53837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fab4f90>
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_517b977e01086a32f2ca44067eb00ac0.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_517b977e01086a32f2ca44067eb00ac0.jpg saved to cache
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccf1410>
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_d204df11acdfe9f493726aea7367f019.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d204df11acdfe9f493726aea7367f019.jpg saved to cache
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-27 11:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a29ab3b-b179-569f-a52d-ca54419ea957 with scrape type 1
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a29ab3b-b179-569f-a52d-ca54419ea957
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_2258b89f1b6e31dad7f36e5a70fa094f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_2258b89f1b6e31dad7f36e5a70fa094f.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_90ace0a24b6d20c0e3fcc3bbff340a6a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_90ace0a24b6d20c0e3fcc3bbff340a6a.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_72447698dc3cfa354a421b779a172dcc.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_72447698dc3cfa354a421b779a172dcc.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_667110896f78eea1a947dd1036f93e36.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_667110896f78eea1a947dd1036f93e36.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_af1dc2b1d6780ac74d4d5a3c7529e9d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_af1dc2b1d6780ac74d4d5a3c7529e9d3.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_7b8f8c5be7ad7a43d1f72baa16126c7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_7b8f8c5be7ad7a43d1f72baa16126c7c.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_85ec449cea78a4a19a67b6e350606607.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_85ec449cea78a4a19a67b6e350606607.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_21c97b953b4215bd4f47c99fd149a1d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_21c97b953b4215bd4f47c99fd149a1d4.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_2335d9690a743e3dcc65dd15478eed24.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_2335d9690a743e3dcc65dd15478eed24.jpg already downloaded
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fec%252F40ece798763e7f08d3d541343a32143f%252Fpa%252FZN66630_6ba608aaee4f44f156020cc60bba924a.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_6ba608aaee4f44f156020cc60bba924a.jpg already downloaded
2026-03-27 11:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a29ab3b-b179-569f-a52d-ca54419ea957, identifier: ZN66630
2026-03-27 11:36:30 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_59b66277aa5d96bef661a0bc12335865.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_59b66277aa5d96bef661a0bc12335865.jpg not downloaded yet
2026-03-27 11:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-27 11:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630
2026-03-27 11:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a29ab3b-b179-569f-a52d-ca54419ea957 with identifier: ZN66630 to the API
2026-03-27 11:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN66630>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:16:47Z',
 'fuel_type': 'petrol',
 'id': '7a29ab3b-b179-569f-a52d-ca54419ea957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN66630',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 115965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_2258b89f1b6e31dad7f36e5a70fa094f.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_90ace0a24b6d20c0e3fcc3bbff340a6a.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_72447698dc3cfa354a421b779a172dcc.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_667110896f78eea1a947dd1036f93e36.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_af1dc2b1d6780ac74d4d5a3c7529e9d3.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_7b8f8c5be7ad7a43d1f72baa16126c7c.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_85ec449cea78a4a19a67b6e350606607.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_21c97b953b4215bd4f47c99fd149a1d4.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_2335d9690a743e3dcc65dd15478eed24.jpg',
                'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_6ba608aaee4f44f156020cc60bba924a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2717928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_2258b89f1b6e31dad7f36e5a70fa094f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2845999,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_90ace0a24b6d20c0e3fcc3bbff340a6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851711,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_72447698dc3cfa354a421b779a172dcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2229197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_667110896f78eea1a947dd1036f93e36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964022,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_af1dc2b1d6780ac74d4d5a3c7529e9d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_7b8f8c5be7ad7a43d1f72baa16126c7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1809763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_85ec449cea78a4a19a67b6e350606607.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2373631,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_21c97b953b4215bd4f47c99fd149a1d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_2335d9690a743e3dcc65dd15478eed24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a29ab3b-b179-569f-a52d-ca54419ea957/7a29ab3b-b179-569f-a52d-ca54419ea957_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/ec/40ece798763e7f08d3d541343a32143f/pa/ZN66630_6ba608aaee4f44f156020cc60bba924a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Saving data for ZN66630: {'created_time': 1774611391.457045, 'last_price_update_time': 1774611391.457056, 'auction_closing_time': 1774714607.0}
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN66630') HTTP/1.1" 204 0
2026-03-27 11:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: XC72414
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: RB01577
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB01577%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for RB01577: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: FA55499
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA55499%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for FA55499: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: YY00182
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB62754%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for CB62754: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ18869%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for DZ18869: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM99393%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for AM99393: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for DT10357: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: HF83279
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX63098%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for KX63098: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: WT46892
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT46892%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for WT46892: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: HR40537
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR40537%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for HR40537: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN00182%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for WN00182: 0
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-27 11:36:31 [auto1.be] INFO: Found listing with ID: JS54526
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS54526%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [auto1.be] INFO: Scrape type for JS54526: 0
2026-03-27 11:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_95d27d5147453aeb3dd3282b56cff2e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_95d27d5147453aeb3dd3282b56cff2e2.jpg not downloaded yet
2026-03-27 11:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837
2026-03-27 11:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with scrape type 1
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_d8e7b8578bade92b1081ad98b5d84506.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d8e7b8578bade92b1081ad98b5d84506.jpg not downloaded yet
2026-03-27 11:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d0baa5eff7dc3a2df7c675b677ce44d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_f7fffa05cd4ed3dae118fd9c8d4f1304.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f7fffa05cd4ed3dae118fd9c8d4f1304.jpg not downloaded yet
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_40d3f7f39dc4542abec232b0f7330ca6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_40d3f7f39dc4542abec232b0f7330ca6.jpg not downloaded yet
2026-03-27 11:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_d89c2e25771f5924309300f5a0a5013f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_54e4f11ffee5e1d47b23160631617c68.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_54e4f11ffee5e1d47b23160631617c68.jpg not downloaded yet
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_b0055dc1fbf42245ef4b3f42cdd349b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_b0055dc1fbf42245ef4b3f42cdd349b4.jpg not downloaded yet
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_f4e7e3d130fd359e9f4f3b0ea8d011d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f4e7e3d130fd359e9f4f3b0ea8d011d4.jpg not downloaded yet
2026-03-27 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_3971ebf71359d55daf48c83ee3211d7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3971ebf71359d55daf48c83ee3211d7c.jpg not downloaded yet
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_59b66277aa5d96bef661a0bc12335865.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_235632387f6e837c3ceaa55211eb1991.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_ab59368df5a2af3a75fab36b22b41b9e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_ab59368df5a2af3a75fab36b22b41b9e.jpg not downloaded yet
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_aebd9ca97ecc7079eeefe7e7e654ded6.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_aebd9ca97ecc7079eeefe7e7e654ded6.jpg not downloaded yet
2026-03-27 11:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce73c90>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_d0baa5eff7dc3a2df7c675b677ce44d4.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d0baa5eff7dc3a2df7c675b677ce44d4.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_54e4f11ffee5e1d47b23160631617c68.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_0c009b6ed373c71a921d02edf7017e5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_0c009b6ed373c71a921d02edf7017e5c.jpg not downloaded yet
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_641a9c4d6af398dd05acf0b169b3f91f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_641a9c4d6af398dd05acf0b169b3f91f.jpg not downloaded yet
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f7fffa05cd4ed3dae118fd9c8d4f1304.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_95d27d5147453aeb3dd3282b56cff2e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_1c64c26c2d37e58b08158199d985279b.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_1c64c26c2d37e58b08158199d985279b.jpg not downloaded yet
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_98c6b2ff975ca45f8bb27e4072966fc5.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_98c6b2ff975ca45f8bb27e4072966fc5.jpg not downloaded yet
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da31b10>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_d89c2e25771f5924309300f5a0a5013f.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_d89c2e25771f5924309300f5a0a5013f.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf10810>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_59b66277aa5d96bef661a0bc12335865.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_59b66277aa5d96bef661a0bc12335865.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cde2590>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_235632387f6e837c3ceaa55211eb1991.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_235632387f6e837c3ceaa55211eb1991.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_40d3f7f39dc4542abec232b0f7330ca6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f4e7e3d130fd359e9f4f3b0ea8d011d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_b0055dc1fbf42245ef4b3f42cdd349b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_30aa10a2d64b1500021b19f330a7c3ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_30aa10a2d64b1500021b19f330a7c3ed.jpg not downloaded yet
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3971ebf71359d55daf48c83ee3211d7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_3bc2c2caf77f70b6c372805a86ce294e.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3bc2c2caf77f70b6c372805a86ce294e.jpg not downloaded yet
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da4a790>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_54e4f11ffee5e1d47b23160631617c68.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_54e4f11ffee5e1d47b23160631617c68.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce51d50>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_f7fffa05cd4ed3dae118fd9c8d4f1304.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f7fffa05cd4ed3dae118fd9c8d4f1304.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8ce310>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_95d27d5147453aeb3dd3282b56cff2e2.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_95d27d5147453aeb3dd3282b56cff2e2.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_ab59368df5a2af3a75fab36b22b41b9e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_d3915d3f4d4963d814813a8957cab5ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d3915d3f4d4963d814813a8957cab5ea.jpg not downloaded yet
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_0c009b6ed373c71a921d02edf7017e5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_1c64c26c2d37e58b08158199d985279b.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_aebd9ca97ecc7079eeefe7e7e654ded6.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cd45c50>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_40d3f7f39dc4542abec232b0f7330ca6.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_40d3f7f39dc4542abec232b0f7330ca6.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce816d0>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_f4e7e3d130fd359e9f4f3b0ea8d011d4.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f4e7e3d130fd359e9f4f3b0ea8d011d4.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf130d0>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_b0055dc1fbf42245ef4b3f42cdd349b4.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_b0055dc1fbf42245ef4b3f42cdd349b4.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da33a50>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_3971ebf71359d55daf48c83ee3211d7c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3971ebf71359d55daf48c83ee3211d7c.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_641a9c4d6af398dd05acf0b169b3f91f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3bc2c2caf77f70b6c372805a86ce294e.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_98c6b2ff975ca45f8bb27e4072966fc5.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134fbf7dd0>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_ab59368df5a2af3a75fab36b22b41b9e.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_ab59368df5a2af3a75fab36b22b41b9e.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da89610>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_0c009b6ed373c71a921d02edf7017e5c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_0c009b6ed373c71a921d02edf7017e5c.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da8b9d0>
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F62%252Fea62d5d6c5de8f80a9e74371c529a870%252Fpa%252FMD39375_1c64c26c2d37e58b08158199d985279b.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_1c64c26c2d37e58b08158199d985279b.jpg saved to cache
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6f213a5-7404-512c-bbab-565407f10070
2026-03-27 11:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6f213a5-7404-512c-bbab-565407f10070, skipping ID generation
2026-03-27 11:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f213a5-7404-512c-bbab-565407f10070 with scrape type 1
2026-03-27 11:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6f213a5-7404-512c-bbab-565407f10070 sending to next pipeline
2026-03-27 11:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6f213a5-7404-512c-bbab-565407f10070, identifier: MD39375
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce641d0>
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_aebd9ca97ecc7079eeefe7e7e654ded6.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_aebd9ca97ecc7079eeefe7e7e654ded6.jpg saved to cache
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-27 11:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-27 11:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375 to the API
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_1c64c26c2d37e58b08158199d985279b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:57:57Z',
 'fuel_type': 'diesel',
 'id': 'c6f213a5-7404-512c-bbab-565407f10070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD39375',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 177128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_235632387f6e837c3ceaa55211eb1991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_d89c2e25771f5924309300f5a0a5013f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_59b66277aa5d96bef661a0bc12335865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_95d27d5147453aeb3dd3282b56cff2e2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f7fffa05cd4ed3dae118fd9c8d4f1304.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_54e4f11ffee5e1d47b23160631617c68.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_f4e7e3d130fd359e9f4f3b0ea8d011d4.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_ab59368df5a2af3a75fab36b22b41b9e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_0c009b6ed373c71a921d02edf7017e5c.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f213a5-7404-512c-bbab-565407f10070/c6f213a5-7404-512c-bbab-565407f10070_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/62/ea62d5d6c5de8f80a9e74371c529a870/pa/MD39375_1c64c26c2d37e58b08158199d985279b.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2014}
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-27 11:36:33 [auto1.be] INFO: Saving data for MD39375: {'created_time': 1774611393.594095, 'last_price_update_time': 1774611393.594108, 'auction_closing_time': 1774717077.0}
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD39375') HTTP/1.1" 204 0
2026-03-27 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_30aa10a2d64b1500021b19f330a7c3ed.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d3915d3f4d4963d814813a8957cab5ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA34397> (referer: https://www.auto1.com/v1/car-details-view/JA34397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da74790>
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fef%252F39ef18bbc8de9b58002f1198b07af829%252Fpa%252FCB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg saved to cache
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63
2026-03-27 11:36:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63, skipping ID generation
2026-03-27 11:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with scrape type 1
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 sending to next pipeline
2026-03-27 11:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63, identifier: CB60498
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cddb2d0>
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_641a9c4d6af398dd05acf0b169b3f91f.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_641a9c4d6af398dd05acf0b169b3f91f.jpg saved to cache
2026-03-27 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d9f7ed0>
2026-03-27 11:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_3bc2c2caf77f70b6c372805a86ce294e.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3bc2c2caf77f70b6c372805a86ce294e.jpg saved to cache
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce64710>
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_98c6b2ff975ca45f8bb27e4072966fc5.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_98c6b2ff975ca45f8bb27e4072966fc5.jpg saved to cache
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498
2026-03-27 11:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498
2026-03-27 11:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63 with identifier: CB60498 to the API
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:58Z',
 'fuel_type': 'petrol',
 'id': '0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB60498',
 'listing': 'auction',
 'location': 'BE, Gent',
 'make': 'Fiat',
 'model': '500',
 'odometer': 70778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_0e4633c55d6460f5120b6af03515929f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_649f86fc8fad797ce2607a78fe352feb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_3ddd17580882b607db5a71e4b6c33c1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_37400b2c0272a5249e1917f16f320777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_7729ada358cf115ba4882f7444237e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2573959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b243a5084f2776ba5d2539435cad03f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719597,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d0baa5eff7dc3a2df7c675b677ce44d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608579,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_b0d7451206639312dd3bea5f3e70ecbb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_517b977e01086a32f2ca44067eb00ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63/0dc7c5e6-ffaf-5c71-a3ad-9da8afe09e63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/ef/39ef18bbc8de9b58002f1198b07af829/pa/CB60498_d204df11acdfe9f493726aea7367f019.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB60498%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Saving data for CB60498: {'created_time': 1774611394.44101, 'last_price_update_time': 1774611394.441023, 'auction_closing_time': 1774713958.0}
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB60498') HTTP/1.1" 204 0
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccfef50>
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_30aa10a2d64b1500021b19f330a7c3ed.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_30aa10a2d64b1500021b19f330a7c3ed.jpg saved to cache
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da749d0>
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_d3915d3f4d4963d814813a8957cab5ea.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d3915d3f4d4963d814813a8957cab5ea.jpg saved to cache
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:34 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-27 11:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb with scrape type 1
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_c00cf6ee37fe3a38f81b37f1e62e324c.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_c00cf6ee37fe3a38f81b37f1e62e324c.jpg not downloaded yet
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR58381%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for TR58381: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: NY46962
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY46962%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for NY46962: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: BF25955
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF25955%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for BF25955: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: UY95301
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: GK93225
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK93225%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for GK93225: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for KE27400: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: WZ59166
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: VR26714
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR26714%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for VR26714: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD48468%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for JD48468: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: JM95627
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: MR00470
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD83049%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for RD83049: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: EJ96741
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96741%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for EJ96741: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ07927%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for RZ07927: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: UM23186
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: YX93920
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: EX80528
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX80528%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for EX80528: 0
2026-03-27 11:36:34 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS47672%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [auto1.be] INFO: Scrape type for VS47672: 0
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_b96056dceb22005011de8cd8d3e762ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_b96056dceb22005011de8cd8d3e762ce.jpg not downloaded yet
2026-03-27 11:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_7a39240b816df72f5394226e5fa189cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_7a39240b816df72f5394226e5fa189cd.jpg not downloaded yet
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_6a74877da8c3d34b785846714ad158b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_6a74877da8c3d34b785846714ad158b2.jpg not downloaded yet
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_3dd6ba07b14c7f801de2ce872e951a96.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_3dd6ba07b14c7f801de2ce872e951a96.jpg not downloaded yet
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_fb1c63f4883c670e69f4d0dfc747a9bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_fb1c63f4883c670e69f4d0dfc747a9bb.jpg not downloaded yet
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_d4df3be2d0afc6f6ac56c2ef375567a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_d4df3be2d0afc6f6ac56c2ef375567a2.jpg not downloaded yet
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg not downloaded yet
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_aa5498377a971633d3cad03fb856c7e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_aa5498377a971633d3cad03fb856c7e3.jpg not downloaded yet
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_e660b2975a25f5ba86d0b2306f16419f.jpg%27 HTTP/1.1" 200 None
2026-03-27 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e660b2975a25f5ba86d0b2306f16419f.jpg not downloaded yet
2026-03-27 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d8e7b8578bade92b1081ad98b5d84506.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_b96056dceb22005011de8cd8d3e762ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_fb1c63f4883c670e69f4d0dfc747a9bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_7a39240b816df72f5394226e5fa189cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_aa5498377a971633d3cad03fb856c7e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_c00cf6ee37fe3a38f81b37f1e62e324c.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 11:36:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:36:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 11:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 11:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 11:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce73410>
2026-03-27 11:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fcb%252Fbccb3e5171169c55a9889a7f28dfbd51%252Fpa%252FNY53837_d8e7b8578bade92b1081ad98b5d84506.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d8e7b8578bade92b1081ad98b5d84506.jpg saved to cache
2026-03-27 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c
2026-03-27 11:36:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c, skipping ID generation
2026-03-27 11:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with scrape type 1
2026-03-27 11:36:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b84c54f0-0bf8-5ed5-aeda-a55141a52b4c sending to next pipeline
2026-03-27 11:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c, identifier: NY53837
2026-03-27 11:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837
2026-03-27 11:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837
2026-03-27 11:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b84c54f0-0bf8-5ed5-aeda-a55141a52b4c with identifier: NY53837 to the API
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d8e7b8578bade92b1081ad98b5d84506.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:08Z',
 'fuel_type': 'diesel',
 'id': 'b84c54f0-0bf8-5ed5-aeda-a55141a52b4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY53837',
 'listing': 'auction',
 'location': 'BE',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 194633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5317315,
             'Height': 4284,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d8e7b8578bade92b1081ad98b5d84506.jpg',
             'Width': 5712},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_40d3f7f39dc4542abec232b0f7330ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_b0055dc1fbf42245ef4b3f42cdd349b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3971ebf71359d55daf48c83ee3211d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_aebd9ca97ecc7079eeefe7e7e654ded6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_641a9c4d6af398dd05acf0b169b3f91f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_98c6b2ff975ca45f8bb27e4072966fc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_30aa10a2d64b1500021b19f330a7c3ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_3bc2c2caf77f70b6c372805a86ce294e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b84c54f0-0bf8-5ed5-aeda-a55141a52b4c/b84c54f0-0bf8-5ed5-aeda-a55141a52b4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/cb/bccb3e5171169c55a9889a7f28dfbd51/pa/NY53837_d3915d3f4d4963d814813a8957cab5ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 Premium Stop&Start',
 'transmission': 'manual',
 'trim': '335 L2H2 Premium Stop&Start',
 'year': 2020}
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY53837%27 HTTP/1.1" 200 None
2026-03-27 11:36:35 [auto1.be] INFO: Saving data for NY53837: {'created_time': 1774611395.944713, 'last_price_update_time': 1774611395.944728, 'auction_closing_time': 1774714688.0}
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY53837') HTTP/1.1" 204 0
2026-03-27 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_3dd6ba07b14c7f801de2ce872e951a96.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e660b2975a25f5ba86d0b2306f16419f.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_d4df3be2d0afc6f6ac56c2ef375567a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf09410>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_1.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_b96056dceb22005011de8cd8d3e762ce.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_b96056dceb22005011de8cd8d3e762ce.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ccf2fd0>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_5.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_fb1c63f4883c670e69f4d0dfc747a9bb.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_fb1c63f4883c670e69f4d0dfc747a9bb.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134da31e90>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_2.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_7a39240b816df72f5394226e5fa189cd.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_7a39240b816df72f5394226e5fa189cd.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134ce52410>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_8.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_aa5498377a971633d3cad03fb856c7e3.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_aa5498377a971633d3cad03fb856c7e3.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d00e990>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_0.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_c00cf6ee37fe3a38f81b37f1e62e324c.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_c00cf6ee37fe3a38f81b37f1e62e324c.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d99a610>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_4.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_3dd6ba07b14c7f801de2ce872e951a96.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_3dd6ba07b14c7f801de2ce872e951a96.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cffdf90>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_9.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_e660b2975a25f5ba86d0b2306f16419f.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e660b2975a25f5ba86d0b2306f16419f.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134d8f2cd0>
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_6.jpg HTTP/1.1" 201 0
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_d4df3be2d0afc6f6ac56c2ef375567a2.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_d4df3be2d0afc6f6ac56c2ef375567a2.jpg saved to cache
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:36 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:36 [auto1.be] INFO: Found listing with ID: XP16826
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP16826%27 HTTP/1.1" 200 None
2026-03-27 11:36:36 [auto1.be] INFO: Scrape type for XP16826: 2
2026-03-27 11:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ab814a-ffe0-51a1-b3b0-0a225813fdc1 with identifier: XP16826
2026-03-27 11:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ab814a-ffe0-51a1-b3b0-0a225813fdc1 with scrape type 2
2026-03-27 11:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66ab814a-ffe0-51a1-b3b0-0a225813fdc1 with scrape type 2
2026-03-27 11:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 66ab814a-ffe0-51a1-b3b0-0a225813fdc1, identifier: XP16826
2026-03-27 11:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 66ab814a-ffe0-51a1-b3b0-0a225813fdc1 with identifier: XP16826
2026-03-27 11:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 66ab814a-ffe0-51a1-b3b0-0a225813fdc1 with identifier: XP16826
2026-03-27 11:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 66ab814a-ffe0-51a1-b3b0-0a225813fdc1 with identifier: XP16826 to the API
2026-03-27 11:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:39:11Z',
 'fuel_type': 'hybrid',
 'id': '66ab814a-ffe0-51a1-b3b0-0a225813fdc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP16826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 165905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2017}
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP16826%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Saving data for XP16826: {'auction_closing_time': 1774629551.0, 'created_time': 1773952761.441214, 'last_price_update_time': 1774611397.170378}
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XP16826') HTTP/1.1" 204 0
2026-03-27 11:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: NC20870
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for MH10936: 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE24792%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for WE24792: 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: AK37394
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: GE39659
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV70453%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for KV70453: 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: WC44537
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC44537%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for WC44537: 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB89914%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for ZB89914: 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for FR59063: 2
2026-03-27 11:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063
2026-03-27 11:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with scrape type 2
2026-03-27 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with scrape type 2
2026-03-27 11:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1868b9b-c402-57ab-b4b1-d96a4586dcf0, identifier: FR59063
2026-03-27 11:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063
2026-03-27 11:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063
2026-03-27 11:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1868b9b-c402-57ab-b4b1-d96a4586dcf0 with identifier: FR59063 to the API
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-27T16:15:46Z',
 'fuel_type': 'diesel',
 'id': 'a1868b9b-c402-57ab-b4b1-d96a4586dcf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR59063',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 216035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-13',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR59063%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Saving data for FR59063: {'auction_closing_time': 1774628146.0, 'created_time': 1774427746.551026, 'last_price_update_time': 1774611397.722942}
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FR59063') HTTP/1.1" 204 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: NK19061
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK19061%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for NK19061: 0
2026-03-27 11:36:37 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-27 11:36:37 [auto1.be] INFO: Scrape type for RS16623: 2
2026-03-27 11:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-27 11:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15dabd15-1724-5fec-9932-b70f222b7e77 with scrape type 2
2026-03-27 11:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15dabd15-1724-5fec-9932-b70f222b7e77 with scrape type 2
2026-03-27 11:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15dabd15-1724-5fec-9932-b70f222b7e77, identifier: RS16623
2026-03-27 11:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-27 11:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-27 11:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623 to the API
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:04:06Z',
 'fuel_type': 'petrol',
 'id': '15dabd15-1724-5fec-9932-b70f222b7e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS16623',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 141191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Active",
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Saving data for RS16623: {'auction_closing_time': 1774627446.0, 'created_time': 1773135652.636807, 'last_price_update_time': 1774611398.279471}
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS16623') HTTP/1.1" 204 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: BM85985
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: MU91514
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU91514%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for MU91514: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: FD33487
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD33487%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for FD33487: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: WC52541
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC52541%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for WC52541: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: LK09797
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: HB52812
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: SP07313
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: JB68456
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB68456%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for JB68456: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR16317%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for MR16317: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA02413%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for UA02413: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: AY21954
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY21954%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for AY21954: 0
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: DK19307
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-27 11:36:38 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY14138%27 HTTP/1.1" 200 None
2026-03-27 11:36:38 [auto1.be] INFO: Scrape type for BY14138: 0
2026-03-27 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_6a74877da8c3d34b785846714ad158b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg> (referer: https://www.auto1.com/)
2026-03-27 11:36:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cf13d10>
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_3.jpg HTTP/1.1" 201 0
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_6a74877da8c3d34b785846714ad158b2.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_6a74877da8c3d34b785846714ad158b2.jpg saved to cache
2026-03-27 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f134cedd010>
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 11:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_7.jpg HTTP/1.1" 201 0
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F6e%252F986e34c0078f6547b1c6d731070876e0%252Fpa%252FJA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg') HTTP/1.1" 204 0
2026-03-27 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg saved to cache
2026-03-27 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb
2026-03-27 11:36:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0920a71-39f6-5dac-87cb-fb128e3d8cbb, skipping ID generation
2026-03-27 11:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb with scrape type 1
2026-03-27 11:36:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0920a71-39f6-5dac-87cb-fb128e3d8cbb sending to next pipeline
2026-03-27 11:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0920a71-39f6-5dac-87cb-fb128e3d8cbb, identifier: JA34397
2026-03-27 11:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-27 11:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397
2026-03-27 11:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0920a71-39f6-5dac-87cb-fb128e3d8cbb with identifier: JA34397 to the API
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:51Z',
 'fuel_type': 'petrol',
 'id': 'c0920a71-39f6-5dac-87cb-fb128e3d8cbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA34397',
 'listing': 'auction',
 'location': 'BE, Kortrijk',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 126696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806809,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_c00cf6ee37fe3a38f81b37f1e62e324c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2930988,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_b96056dceb22005011de8cd8d3e762ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_7a39240b816df72f5394226e5fa189cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_6a74877da8c3d34b785846714ad158b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_3dd6ba07b14c7f801de2ce872e951a96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_fb1c63f4883c670e69f4d0dfc747a9bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_d4df3be2d0afc6f6ac56c2ef375567a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e8cf32d4e2f6e57f7be0685b50d9e073.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_aa5498377a971633d3cad03fb856c7e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0920a71-39f6-5dac-87cb-fb128e3d8cbb/c0920a71-39f6-5dac-87cb-fb128e3d8cbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/6e/986e34c0078f6547b1c6d731070876e0/pa/JA34397_e660b2975a25f5ba86d0b2306f16419f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Saving data for JA34397: {'created_time': 1774611399.55852, 'last_price_update_time': 1774611399.558532, 'auction_closing_time': 1774716411.0}
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JA34397') HTTP/1.1" 204 0
2026-03-27 11:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:39 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: JC10329
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC10329%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for JC10329: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: KL87992
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: BB18190
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB18190%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for BB18190: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW31488%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for ZW31488: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: GU40914
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: ZG29965
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG29965%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for ZG29965: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: TE01845
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: SM05955
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: FH77078
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH77078%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for FH77078: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: LA53308
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA53308%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for LA53308: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: ER20573
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER20573%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for ER20573: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05336%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for GS05336: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: JC36260
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC36260%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for JC36260: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: SW67085
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW67085%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for SW67085: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: WN81637
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: PX40463
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX40463%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for PX40463: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC57264%27 HTTP/1.1" 200 None
2026-03-27 11:36:39 [auto1.be] INFO: Scrape type for PC57264: 0
2026-03-27 11:36:39 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW94232%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for GW94232: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: HX20099
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX20099%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for HX20099: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: VV09395
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF99667%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for VF99667: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: GV19047
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV19047%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for GV19047: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for TU34385: 2
2026-03-27 11:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385
2026-03-27 11:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d004143a-8188-5706-9c65-cb140f369326 with scrape type 2
2026-03-27 11:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d004143a-8188-5706-9c65-cb140f369326 with scrape type 2
2026-03-27 11:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d004143a-8188-5706-9c65-cb140f369326, identifier: TU34385
2026-03-27 11:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385
2026-03-27 11:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385
2026-03-27 11:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d004143a-8188-5706-9c65-cb140f369326 with identifier: TU34385 to the API
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:34:43Z',
 'fuel_type': 'diesel',
 'id': 'd004143a-8188-5706-9c65-cb140f369326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU34385',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 176254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU34385%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Saving data for TU34385: {'auction_closing_time': 1774629283.0, 'created_time': 1774427750.871642, 'last_price_update_time': 1774611400.488841}
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU34385') HTTP/1.1" 204 0
2026-03-27 11:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: TV74985
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV74985%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for TV74985: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV88346%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for YV88346: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: DN97362
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL06267%27 HTTP/1.1" 200 None
2026-03-27 11:36:40 [auto1.be] INFO: Scrape type for ZL06267: 0
2026-03-27 11:36:40 [auto1.be] INFO: Found listing with ID: YG56736
2026-03-27 11:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:41 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: SY66485
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY66485%27 HTTP/1.1" 200 None
2026-03-27 11:36:41 [auto1.be] INFO: Scrape type for SY66485: 0
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF62281%27 HTTP/1.1" 200 None
2026-03-27 11:36:41 [auto1.be] INFO: Scrape type for BF62281: 0
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: KB97788
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG88652%27 HTTP/1.1" 200 None
2026-03-27 11:36:41 [auto1.be] INFO: Scrape type for NG88652: 0
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: NA06966
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: GT94286
2026-03-27 11:36:41 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-27 11:36:41 [auto1.be] INFO: Scrape type for EJ45818: 2
2026-03-27 11:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818
2026-03-27 11:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e9a68e-0189-5d58-a461-9d7b181b6ebc with scrape type 2
2026-03-27 11:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20e9a68e-0189-5d58-a461-9d7b181b6ebc with scrape type 2
2026-03-27 11:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20e9a68e-0189-5d58-a461-9d7b181b6ebc, identifier: EJ45818
2026-03-27 11:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818
2026-03-27 11:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818
2026-03-27 11:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20e9a68e-0189-5d58-a461-9d7b181b6ebc with identifier: EJ45818 to the API
2026-03-27 11:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:16:34Z',
 'fuel_type': 'hybrid',
 'id': '20e9a68e-0189-5d58-a461-9d7b181b6ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ45818',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 153228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-20',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45818%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Saving data for EJ45818: {'auction_closing_time': 1774628194.0, 'created_time': 1773136471.778212, 'last_price_update_time': 1774611402.149691}
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ45818') HTTP/1.1" 204 0
2026-03-27 11:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN95173%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for KN95173: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: DV17343
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM08929%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for WM08929: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: JS73034
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: YT32730
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT32730%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for YT32730: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: EW15298
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: BX57977
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX57977%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for BX57977: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD21641%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for TD21641: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: HA21720
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP38880%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for CP38880: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: GC12715
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: CM84759
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: DN62298
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: HX60509
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: ZW91403
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: RK04043
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN48415%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for HN48415: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL24574%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for JL24574: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: HA16035
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA16035%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for HA16035: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: LS47713
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS47713%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for LS47713: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: EF75882
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG25655%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for WG25655: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE01185%27 HTTP/1.1" 200 None
2026-03-27 11:36:42 [auto1.be] INFO: Scrape type for JE01185: 0
2026-03-27 11:36:42 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-27 11:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:43 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1871 | hits on page: 40
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: KS84566
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: PX88472
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM70865%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for HM70865: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: WN70923
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: UD60313
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD60313%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for UD60313: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64261%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for UE64261: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: VJ74010
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ74010%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for VJ74010: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: DV87479
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: BT30739
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for TX28125: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: TY33491
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY33491%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for TY33491: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: JM03834
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: RB51541
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR75863%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for NR75863: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: ZZ58994
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: HB75588
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB75588%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for HB75588: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: GF87206
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF87206%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for GF87206: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: UU36323
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ92638%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for EZ92638: 0
2026-03-27 11:36:43 [auto1.be] INFO: Found listing with ID: ZY78390
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY78390%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Scrape type for ZY78390: 2
2026-03-27 11:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8946af6c-27fc-5f48-873d-3e7bcd733890 with identifier: ZY78390
2026-03-27 11:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8946af6c-27fc-5f48-873d-3e7bcd733890 with scrape type 2
2026-03-27 11:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8946af6c-27fc-5f48-873d-3e7bcd733890 with scrape type 2
2026-03-27 11:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8946af6c-27fc-5f48-873d-3e7bcd733890, identifier: ZY78390
2026-03-27 11:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8946af6c-27fc-5f48-873d-3e7bcd733890 with identifier: ZY78390
2026-03-27 11:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8946af6c-27fc-5f48-873d-3e7bcd733890 with identifier: ZY78390
2026-03-27 11:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8946af6c-27fc-5f48-873d-3e7bcd733890 with identifier: ZY78390 to the API
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-27T16:08:45Z',
 'fuel_type': 'diesel',
 'id': '8946af6c-27fc-5f48-873d-3e7bcd733890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY78390',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 212344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 3.0 Td6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2017}
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY78390%27 HTTP/1.1" 200 None
2026-03-27 11:36:43 [auto1.be] INFO: Saving data for ZY78390: {'auction_closing_time': 1774627725.0, 'created_time': 1774341353.469553, 'last_price_update_time': 1774611403.990278}
2026-03-27 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY78390') HTTP/1.1" 204 0
2026-03-27 11:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:44 [auto1.be] INFO: Found listing with ID: XJ77017
2026-03-27 11:36:44 [auto1.be] INFO: Found listing with ID: PN24466
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN24466%27 HTTP/1.1" 200 None
2026-03-27 11:36:44 [auto1.be] INFO: Scrape type for PN24466: 0
2026-03-27 11:36:44 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-27 11:36:44 [auto1.be] INFO: Scrape type for WP70532: 2
2026-03-27 11:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532
2026-03-27 11:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with scrape type 2
2026-03-27 11:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with scrape type 2
2026-03-27 11:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a80c4c9a-7073-52b6-9878-69e8f2d3cae5, identifier: WP70532
2026-03-27 11:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532
2026-03-27 11:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532
2026-03-27 11:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a80c4c9a-7073-52b6-9878-69e8f2d3cae5 with identifier: WP70532 to the API
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:28:12Z',
 'fuel_type': 'diesel',
 'id': 'a80c4c9a-7073-52b6-9878-69e8f2d3cae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP70532',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 67256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Longitude 4WD',
 'transmission': 'automatic',
 'trim': 'Longitude 4WD',
 'year': 2020}
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP70532%27 HTTP/1.1" 200 None
2026-03-27 11:36:44 [auto1.be] INFO: Saving data for WP70532: {'auction_closing_time': 1774628892.0, 'created_time': 1774427760.78505, 'last_price_update_time': 1774611404.640455}
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP70532') HTTP/1.1" 204 0
2026-03-27 11:36:44 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY85639%27 HTTP/1.1" 200 None
2026-03-27 11:36:44 [auto1.be] INFO: Scrape type for HY85639: 0
2026-03-27 11:36:44 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-27 11:36:44 [auto1.be] INFO: Scrape type for ET07668: 2
2026-03-27 11:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668
2026-03-27 11:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with scrape type 2
2026-03-27 11:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with scrape type 2
2026-03-27 11:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2688a6cd-bd9b-5d39-9ccc-13847ccac833, identifier: ET07668
2026-03-27 11:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668
2026-03-27 11:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668
2026-03-27 11:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2688a6cd-bd9b-5d39-9ccc-13847ccac833 with identifier: ET07668 to the API
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:24:29Z',
 'fuel_type': 'diesel',
 'id': '2688a6cd-bd9b-5d39-9ccc-13847ccac833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET07668',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 144898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 1,2t Family',
 'transmission': 'manual',
 'trim': 'L2H1 1,2t Family',
 'year': 2018}
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET07668%27 HTTP/1.1" 200 None
2026-03-27 11:36:45 [auto1.be] INFO: Saving data for ET07668: {'auction_closing_time': 1774628669.0, 'created_time': 1773240573.952635, 'last_price_update_time': 1774611405.099246}
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET07668') HTTP/1.1" 204 0
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT96766%27 HTTP/1.1" 200 None
2026-03-27 11:36:45 [auto1.be] INFO: Scrape type for UT96766: 0
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: GL72851
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL72851%27 HTTP/1.1" 200 None
2026-03-27 11:36:45 [auto1.be] INFO: Scrape type for GL72851: 0
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: WF34638
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: GF79984
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: GH08369
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: RS06619
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS06619%27 HTTP/1.1" 200 None
2026-03-27 11:36:45 [auto1.be] INFO: Scrape type for RS06619: 0
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: BA04765
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA04765%27 HTTP/1.1" 200 None
2026-03-27 11:36:45 [auto1.be] INFO: Scrape type for BA04765: 0
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-27 11:36:45 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-27 11:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:46 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1872 | hits on page: 40
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU62289%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for EU62289: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK78813%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for CK78813: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: DU82923
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: XE32129
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE32129%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for XE32129: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: FT17632
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for KE03465: 2
2026-03-27 11:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465
2026-03-27 11:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with scrape type 2
2026-03-27 11:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with scrape type 2
2026-03-27 11:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1, identifier: KE03465
2026-03-27 11:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465
2026-03-27 11:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465
2026-03-27 11:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1 with identifier: KE03465 to the API
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:43:43Z',
 'fuel_type': 'diesel',
 'id': '9d7c6f3a-4d57-5abc-9edc-29d1a5bd11d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE03465',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 107544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE03465%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Saving data for KE03465: {'auction_closing_time': 1774629823.0, 'created_time': 1774427738.492855, 'last_price_update_time': 1774611406.686602}
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE03465') HTTP/1.1" 204 0
2026-03-27 11:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: PB50741
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU70188%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for JU70188: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: NZ71290
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ71290%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for NZ71290: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP50395%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for RP50395: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: XU08826
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU08826%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for XU08826: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: UG87169
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG87169%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for UG87169: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: WF35410
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF35410%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for WF35410: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: NG85298
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: SR96729
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: FK63075
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK63075%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for FK63075: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN70818%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for YN70818: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: NX07614
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ60295%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for DZ60295: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: JV06807
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: XP06232
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: CU54965
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU54965%27 HTTP/1.1" 200 None
2026-03-27 11:36:46 [auto1.be] INFO: Scrape type for CU54965: 0
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-27 11:36:46 [auto1.be] INFO: Found listing with ID: VP78052
2026-03-27 11:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78052%27 HTTP/1.1" 200 None
2026-03-27 11:36:47 [auto1.be] INFO: Scrape type for VP78052: 0
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: LU57282
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU57282%27 HTTP/1.1" 200 None
2026-03-27 11:36:47 [auto1.be] INFO: Scrape type for LU57282: 0
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: RR45752
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: SN11216
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: JZ23244
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ23244%27 HTTP/1.1" 200 None
2026-03-27 11:36:47 [auto1.be] INFO: Scrape type for JZ23244: 0
2026-03-27 11:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:47 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1872 | hits on page: 40
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH22912%27 HTTP/1.1" 200 None
2026-03-27 11:36:47 [auto1.be] INFO: Scrape type for LH22912: 0
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: VA33798
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33798%27 HTTP/1.1" 200 None
2026-03-27 11:36:47 [auto1.be] INFO: Scrape type for VA33798: 0
2026-03-27 11:36:47 [auto1.be] INFO: Found listing with ID: SH58786
2026-03-27 11:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SH58786%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for SH58786: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR78742%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for JR78742: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for RL53364: 2
2026-03-27 11:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364
2026-03-27 11:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287e9706-619d-5169-844e-d9e9e41c15c5 with scrape type 2
2026-03-27 11:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287e9706-619d-5169-844e-d9e9e41c15c5 with scrape type 2
2026-03-27 11:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 287e9706-619d-5169-844e-d9e9e41c15c5, identifier: RL53364
2026-03-27 11:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-27 11:36:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364
2026-03-27 11:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 287e9706-619d-5169-844e-d9e9e41c15c5 with identifier: RL53364 to the API
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:16:32Z',
 'fuel_type': 'petrol',
 'id': '287e9706-619d-5169-844e-d9e9e41c15c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL53364',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 124763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-05',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL53364%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Saving data for RL53364: {'auction_closing_time': 1774628192.0, 'created_time': 1773239495.172672, 'last_price_update_time': 1774611408.662556}
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL53364') HTTP/1.1" 204 0
2026-03-27 11:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: PR99089
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: HL56406
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL56406%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for HL56406: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY60433%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for KY60433: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: RS25699
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: SU77944
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU77944%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for SU77944: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: SF71038
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: FF97122
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF97122%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for FF97122: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: HL05710
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL05710%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for HL05710: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: LD17211
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: JZ19125
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: YK68229
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK68229%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for YK68229: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM06752%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for KM06752: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56450%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for CW56450: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: RU12474
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU12474%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for RU12474: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for NA97131: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68139%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for GM68139: 0
2026-03-27 11:36:48 [auto1.be] INFO: Found listing with ID: EK14567
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14567%27 HTTP/1.1" 200 None
2026-03-27 11:36:48 [auto1.be] INFO: Scrape type for EK14567: 2
2026-03-27 11:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c1e19e-e612-58d6-9bfa-f5287597f90c with identifier: EK14567
2026-03-27 11:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c1e19e-e612-58d6-9bfa-f5287597f90c with scrape type 2
2026-03-27 11:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c1e19e-e612-58d6-9bfa-f5287597f90c with scrape type 2
2026-03-27 11:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80c1e19e-e612-58d6-9bfa-f5287597f90c, identifier: EK14567
2026-03-27 11:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80c1e19e-e612-58d6-9bfa-f5287597f90c with identifier: EK14567
2026-03-27 11:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80c1e19e-e612-58d6-9bfa-f5287597f90c with identifier: EK14567
2026-03-27 11:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80c1e19e-e612-58d6-9bfa-f5287597f90c with identifier: EK14567 to the API
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:58:42Z',
 'fuel_type': 'diesel',
 'id': '80c1e19e-e612-58d6-9bfa-f5287597f90c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK14567',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 216775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-12',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Intensive',
 'transmission': 'manual',
 'trim': 'Intensive',
 'year': 2016}
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14567%27 HTTP/1.1" 200 None
2026-03-27 11:36:49 [auto1.be] INFO: Saving data for EK14567: {'auction_closing_time': 1774630722.0, 'created_time': 1774341329.317544, 'last_price_update_time': 1774611409.398393}
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK14567') HTTP/1.1" 204 0
2026-03-27 11:36:49 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL13165%27 HTTP/1.1" 200 None
2026-03-27 11:36:49 [auto1.be] INFO: Scrape type for VL13165: 0
2026-03-27 11:36:49 [auto1.be] INFO: Found listing with ID: KD31159
2026-03-27 11:36:49 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-27 11:36:49 [auto1.be] INFO: Scrape type for HL89741: 2
2026-03-27 11:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741
2026-03-27 11:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with scrape type 2
2026-03-27 11:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with scrape type 2
2026-03-27 11:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba, identifier: HL89741
2026-03-27 11:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741
2026-03-27 11:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741
2026-03-27 11:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65dd1e9b-07f8-554c-a2f3-57e03f27d0ba with identifier: HL89741 to the API
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:47:28Z',
 'fuel_type': 'diesel',
 'id': '65dd1e9b-07f8-554c-a2f3-57e03f27d0ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL89741',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 203710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2017}
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL89741%27 HTTP/1.1" 200 None
2026-03-27 11:36:49 [auto1.be] INFO: Saving data for HL89741: {'auction_closing_time': 1774630048.0, 'created_time': 1774427759.024696, 'last_price_update_time': 1774611409.962897}
2026-03-27 11:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL89741') HTTP/1.1" 204 0
2026-03-27 11:36:50 [auto1.be] INFO: Found listing with ID: HP19599
2026-03-27 11:36:50 [auto1.be] INFO: Found listing with ID: HN90947
2026-03-27 11:36:50 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR57009%27 HTTP/1.1" 200 None
2026-03-27 11:36:50 [auto1.be] INFO: Scrape type for TR57009: 0
2026-03-27 11:36:50 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-27 11:36:50 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-27 11:36:50 [auto1.be] INFO: Scrape type for PV35906: 2
2026-03-27 11:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-27 11:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e909e59a-6370-539e-96ba-297396904918 with scrape type 2
2026-03-27 11:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e909e59a-6370-539e-96ba-297396904918 with scrape type 2
2026-03-27 11:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e909e59a-6370-539e-96ba-297396904918, identifier: PV35906
2026-03-27 11:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-27 11:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-27 11:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906 to the API
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:20:54Z',
 'fuel_type': 'petrol',
 'id': 'e909e59a-6370-539e-96ba-297396904918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV35906',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 23331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-19',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2023}
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-27 11:36:50 [auto1.be] INFO: Saving data for PV35906: {'auction_closing_time': 1774628454.0, 'created_time': 1773132023.169378, 'last_price_update_time': 1774611410.481477}
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV35906') HTTP/1.1" 204 0
2026-03-27 11:36:50 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-27 11:36:50 [auto1.be] INFO: Scrape type for TX99790: 0
2026-03-27 11:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:51 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1872 | hits on page: 40
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: LM46690
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM46690%27 HTTP/1.1" 200 None
2026-03-27 11:36:51 [auto1.be] INFO: Scrape type for LM46690: 0
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-27 11:36:51 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF01400%27 HTTP/1.1" 200 None
2026-03-27 11:36:51 [auto1.be] INFO: Scrape type for JF01400: 2
2026-03-27 11:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc with identifier: JF01400
2026-03-27 11:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc with scrape type 2
2026-03-27 11:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc with scrape type 2
2026-03-27 11:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc, identifier: JF01400
2026-03-27 11:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc with identifier: JF01400
2026-03-27 11:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc with identifier: JF01400
2026-03-27 11:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0dc40909-e6c4-5df3-b30e-52bd6bbe36dc with identifier: JF01400 to the API
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:52:37Z',
 'fuel_type': 'diesel',
 'id': '0dc40909-e6c4-5df3-b30e-52bd6bbe36dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF01400',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 160455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-30',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2008}
2026-03-27 11:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF01400%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Saving data for JF01400: {'auction_closing_time': 1774630357.0, 'created_time': 1774427751.376523, 'last_price_update_time': 1774611412.005542}
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JF01400') HTTP/1.1" 204 0
2026-03-27 11:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: TR88361
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: XN17916
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: ZP16804
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: VD34394
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD34394%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for VD34394: 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: BV48313
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48313%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for BV48313: 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN37079%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for NN37079: 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: HP20336
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP20336%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for HP20336: 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: NH80895
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH80895%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for NH80895: 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: AH50930
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: UY55181
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY55181%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for UY55181: 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: KE76043
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: WR26976
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for RV20515: 2
2026-03-27 11:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-27 11:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with scrape type 2
2026-03-27 11:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with scrape type 2
2026-03-27 11:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b, identifier: RV20515
2026-03-27 11:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-27 11:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-27 11:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515 to the API
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-27T16:29:51Z',
 'fuel_type': 'petrol',
 'id': '7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV20515',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 38986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Saving data for RV20515: {'auction_closing_time': 1774628991.0, 'created_time': 1774039063.593968, 'last_price_update_time': 1774611412.643919}
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RV20515') HTTP/1.1" 204 0
2026-03-27 11:36:52 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-27 11:36:52 [auto1.be] INFO: Scrape type for JX10335: 2
2026-03-27 11:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335
2026-03-27 11:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with scrape type 2
2026-03-27 11:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with scrape type 2
2026-03-27 11:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 584ef37c-4e9b-5736-a901-e1ef545bc1d3, identifier: JX10335
2026-03-27 11:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335
2026-03-27 11:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335
2026-03-27 11:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 584ef37c-4e9b-5736-a901-e1ef545bc1d3 with identifier: JX10335 to the API
2026-03-27 11:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:10:26Z',
 'fuel_type': 'diesel',
 'id': '584ef37c-4e9b-5736-a901-e1ef545bc1d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX10335',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 191035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2017}
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX10335%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Saving data for JX10335: {'auction_closing_time': 1774627826.0, 'created_time': 1773238231.767809, 'last_price_update_time': 1774611413.176068}
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX10335') HTTP/1.1" 204 0
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: YL61422
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV96305%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Scrape type for NV96305: 0
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: BC73637
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Scrape type for BH52169: 2
2026-03-27 11:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-27 11:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with scrape type 2
2026-03-27 11:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with scrape type 2
2026-03-27 11:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0218965c-52a3-56e7-9b12-efd2fe68a2c0, identifier: BH52169
2026-03-27 11:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-27 11:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-27 11:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169 to the API
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:41:23Z',
 'fuel_type': 'diesel',
 'id': '0218965c-52a3-56e7-9b12-efd2fe68a2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH52169',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 149890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-29',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2012}
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Saving data for BH52169: {'auction_closing_time': 1774629683.0, 'created_time': 1773135185.488072, 'last_price_update_time': 1774611413.733134}
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BH52169') HTTP/1.1" 204 0
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: XH13020
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: FG51485
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15441%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Scrape type for CH15441: 0
2026-03-27 11:36:53 [auto1.be] INFO: Found listing with ID: JJ92439
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ92439%27 HTTP/1.1" 200 None
2026-03-27 11:36:53 [auto1.be] INFO: Scrape type for JJ92439: 0
2026-03-27 11:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:54 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1872 | hits on page: 40
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: HA54004
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA54004%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for HA54004: 0
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: EM07100
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM07100%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for EM07100: 0
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN79459%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for UN79459: 0
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE10158%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for AE10158: 0
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB43323%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for EB43323: 0
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: MZ25594
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ25594%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for MZ25594: 0
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-27 11:36:54 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-27 11:36:54 [auto1.be] INFO: Scrape type for FA45415: 2
2026-03-27 11:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415
2026-03-27 11:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90d86897-f228-551e-83ea-bbca7ed1c09f with scrape type 2
2026-03-27 11:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90d86897-f228-551e-83ea-bbca7ed1c09f with scrape type 2
2026-03-27 11:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90d86897-f228-551e-83ea-bbca7ed1c09f, identifier: FA45415
2026-03-27 11:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415
2026-03-27 11:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415
2026-03-27 11:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90d86897-f228-551e-83ea-bbca7ed1c09f with identifier: FA45415 to the API
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:36:35Z',
 'fuel_type': 'diesel',
 'id': '90d86897-f228-551e-83ea-bbca7ed1c09f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA45415',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 114652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
 'transmission': 'manual',
 'trim': '33 L2H2 Club Start&Stop',
 'year': 2020}
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA45415%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Saving data for FA45415: {'auction_closing_time': 1774629395.0, 'created_time': 1773693616.100371, 'last_price_update_time': 1774611415.34049}
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA45415') HTTP/1.1" 204 0
2026-03-27 11:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: WV41527
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV41527%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for WV41527: 0
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL08078%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for SL08078: 0
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: YK02939
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: GM72462
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM72462%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for GM72462: 0
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY49769%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for XY49769: 0
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: GX90247
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX90247%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for GX90247: 2
2026-03-27 11:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a68b6f-2280-54eb-9f51-ab41eb1d28ff with identifier: GX90247
2026-03-27 11:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a68b6f-2280-54eb-9f51-ab41eb1d28ff with scrape type 2
2026-03-27 11:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a68b6f-2280-54eb-9f51-ab41eb1d28ff with scrape type 2
2026-03-27 11:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11a68b6f-2280-54eb-9f51-ab41eb1d28ff, identifier: GX90247
2026-03-27 11:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11a68b6f-2280-54eb-9f51-ab41eb1d28ff with identifier: GX90247
2026-03-27 11:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11a68b6f-2280-54eb-9f51-ab41eb1d28ff with identifier: GX90247
2026-03-27 11:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11a68b6f-2280-54eb-9f51-ab41eb1d28ff with identifier: GX90247 to the API
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:45:15Z',
 'fuel_type': 'petrol',
 'id': '11a68b6f-2280-54eb-9f51-ab41eb1d28ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX90247',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 71874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2020}
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX90247%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Saving data for GX90247: {'auction_closing_time': 1774629915.0, 'created_time': 1774427763.057682, 'last_price_update_time': 1774611415.927126}
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX90247') HTTP/1.1" 204 0
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: AV95380
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL07479%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for FL07479: 0
2026-03-27 11:36:55 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-27 11:36:55 [auto1.be] INFO: Scrape type for RJ01486: 2
2026-03-27 11:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-27 11:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with scrape type 2
2026-03-27 11:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with scrape type 2
2026-03-27 11:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f, identifier: RJ01486
2026-03-27 11:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-27 11:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486
2026-03-27 11:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ea3fdf4-850d-5507-bda1-a0321c4b8a1f with identifier: RJ01486 to the API
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:24:02Z',
 'fuel_type': 'petrol',
 'id': '4ea3fdf4-850d-5507-bda1-a0321c4b8a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ01486',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 118811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Saving data for RJ01486: {'auction_closing_time': 1774628642.0, 'created_time': 1773133983.568671, 'last_price_update_time': 1774611416.367073}
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ01486') HTTP/1.1" 204 0
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: NN78164
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: NG69023
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG69023%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Scrape type for NG69023: 2
2026-03-27 11:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ca7c7e-cc3d-503f-a1e9-20814f339d8a with identifier: NG69023
2026-03-27 11:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ca7c7e-cc3d-503f-a1e9-20814f339d8a with scrape type 2
2026-03-27 11:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ca7c7e-cc3d-503f-a1e9-20814f339d8a with scrape type 2
2026-03-27 11:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96ca7c7e-cc3d-503f-a1e9-20814f339d8a, identifier: NG69023
2026-03-27 11:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96ca7c7e-cc3d-503f-a1e9-20814f339d8a with identifier: NG69023
2026-03-27 11:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96ca7c7e-cc3d-503f-a1e9-20814f339d8a with identifier: NG69023
2026-03-27 11:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96ca7c7e-cc3d-503f-a1e9-20814f339d8a with identifier: NG69023 to the API
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:07:45Z',
 'fuel_type': 'diesel',
 'id': '96ca7c7e-cc3d-503f-a1e9-20814f339d8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG69023',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 126829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG69023%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Saving data for NG69023: {'auction_closing_time': 1774627665.0, 'created_time': 1773240503.379924, 'last_price_update_time': 1774611416.908301}
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG69023') HTTP/1.1" 204 0
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: XN13667
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN13667%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Scrape type for XN13667: 0
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AH50870%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Scrape type for AH50870: 0
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN14983%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Scrape type for AN14983: 0
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: MG69856
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG69856%27 HTTP/1.1" 200 None
2026-03-27 11:36:56 [auto1.be] INFO: Scrape type for MG69856: 0
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-27 11:36:56 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV18687%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for CV18687: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ92015%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for DJ92015: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: GA88008
2026-03-27 11:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:36:57 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1872 | hits on page: 40
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: AD35856
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD35856%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for AD35856: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: KA73952
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA73952%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for KA73952: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: RL11513
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL11513%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for RL11513: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC36147%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for DC36147: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM50519%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for UM50519: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: MB10868
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA35148%27 HTTP/1.1" 200 None
2026-03-27 11:36:57 [auto1.be] INFO: Scrape type for RA35148: 0
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: GT81983
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-27 11:36:57 [auto1.be] INFO: Found listing with ID: EX70001
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX70001%27 HTTP/1.1" 200 None
2026-03-27 11:36:58 [auto1.be] INFO: Scrape type for EX70001: 2
2026-03-27 11:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59 with identifier: EX70001
2026-03-27 11:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59 with scrape type 2
2026-03-27 11:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59 with scrape type 2
2026-03-27 11:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59, identifier: EX70001
2026-03-27 11:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59 with identifier: EX70001
2026-03-27 11:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59 with identifier: EX70001
2026-03-27 11:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12b0e3dd-0acd-5084-8eff-1ae6a41c1e59 with identifier: EX70001 to the API
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:42:08Z',
 'fuel_type': 'diesel',
 'id': '12b0e3dd-0acd-5084-8eff-1ae6a41c1e59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX70001',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 217062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-11',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX70001%27 HTTP/1.1" 200 None
2026-03-27 11:36:58 [auto1.be] INFO: Saving data for EX70001: {'auction_closing_time': 1774629728.0, 'created_time': 1773240379.245312, 'last_price_update_time': 1774611418.4515}
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX70001') HTTP/1.1" 204 0
2026-03-27 11:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:36:58 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-27 11:36:58 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-27 11:36:58 [auto1.be] INFO: Found listing with ID: JV20060
2026-03-27 11:36:58 [auto1.be] INFO: Found listing with ID: ZW65724
2026-03-27 11:36:58 [auto1.be] INFO: Found listing with ID: AP34233
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP34233%27 HTTP/1.1" 200 None
2026-03-27 11:36:58 [auto1.be] INFO: Scrape type for AP34233: 2
2026-03-27 11:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f07079bc-b7eb-51c6-9abd-09c9d829d977 with identifier: AP34233
2026-03-27 11:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f07079bc-b7eb-51c6-9abd-09c9d829d977 with scrape type 2
2026-03-27 11:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f07079bc-b7eb-51c6-9abd-09c9d829d977 with scrape type 2
2026-03-27 11:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f07079bc-b7eb-51c6-9abd-09c9d829d977, identifier: AP34233
2026-03-27 11:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f07079bc-b7eb-51c6-9abd-09c9d829d977 with identifier: AP34233
2026-03-27 11:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f07079bc-b7eb-51c6-9abd-09c9d829d977 with identifier: AP34233
2026-03-27 11:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f07079bc-b7eb-51c6-9abd-09c9d829d977 with identifier: AP34233 to the API
2026-03-27 11:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:24:05Z',
 'fuel_type': 'petrol',
 'id': 'f07079bc-b7eb-51c6-9abd-09c9d829d977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP34233',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 72688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2019}
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP34233%27 HTTP/1.1" 200 None
2026-03-27 11:36:59 [auto1.be] INFO: Saving data for AP34233: {'auction_closing_time': 1774628645.0, 'created_time': 1773134016.530988, 'last_price_update_time': 1774611419.354981}
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP34233') HTTP/1.1" 204 0
2026-03-27 11:36:59 [auto1.be] INFO: Found listing with ID: XT57360
2026-03-27 11:36:59 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-27 11:36:59 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-27 11:36:59 [auto1.be] INFO: Found listing with ID: CP79509
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP79509%27 HTTP/1.1" 200 None
2026-03-27 11:36:59 [auto1.be] INFO: Scrape type for CP79509: 0
2026-03-27 11:36:59 [auto1.be] INFO: Found listing with ID: FN58645
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN58645%27 HTTP/1.1" 200 None
2026-03-27 11:36:59 [auto1.be] INFO: Scrape type for FN58645: 2
2026-03-27 11:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30bf40d2-fef3-5f53-bb4b-67ece1780ed5 with identifier: FN58645
2026-03-27 11:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30bf40d2-fef3-5f53-bb4b-67ece1780ed5 with scrape type 2
2026-03-27 11:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30bf40d2-fef3-5f53-bb4b-67ece1780ed5 with scrape type 2
2026-03-27 11:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30bf40d2-fef3-5f53-bb4b-67ece1780ed5, identifier: FN58645
2026-03-27 11:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30bf40d2-fef3-5f53-bb4b-67ece1780ed5 with identifier: FN58645
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 11:36:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 11:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30bf40d2-fef3-5f53-bb4b-67ece1780ed5 with identifier: FN58645
2026-03-27 11:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30bf40d2-fef3-5f53-bb4b-67ece1780ed5 with identifier: FN58645 to the API
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-27T16:12:31Z',
 'fuel_type': 'petrol',
 'id': '30bf40d2-fef3-5f53-bb4b-67ece1780ed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN58645',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 223325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2003}
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN58645%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Saving data for FN58645: {'auction_closing_time': 1774627951.0, 'created_time': 1773953458.943198, 'last_price_update_time': 1774611420.025356}
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN58645') HTTP/1.1" 204 0
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Scrape type for PE70540: 2
2026-03-27 11:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-27 11:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with scrape type 2
2026-03-27 11:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with scrape type 2
2026-03-27 11:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb, identifier: PE70540
2026-03-27 11:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-27 11:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540
2026-03-27 11:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb with identifier: PE70540 to the API
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:38:54Z',
 'fuel_type': 'petrol',
 'id': '9076d88c-3c6f-5b1d-acaf-4d330b8bc8fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE70540',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 184331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2013}
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Saving data for PE70540: {'auction_closing_time': 1774629534.0, 'created_time': 1773239461.286606, 'last_price_update_time': 1774611420.484702}
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE70540') HTTP/1.1" 204 0
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: SB65944
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: ZT51851
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: BW33420
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: AW12506
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW12506%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Scrape type for AW12506: 0
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: CT13116
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT13116%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Scrape type for CT13116: 0
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU20603%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Scrape type for BU20603: 0
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PA07784%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Scrape type for PA07784: 0
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: VM27980
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-27 11:37:00 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-27 11:37:00 [auto1.be] INFO: Scrape type for YB34897: 2
2026-03-27 11:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897
2026-03-27 11:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1583b4f-d49b-54b2-9986-3ee13e10e56f with scrape type 2
2026-03-27 11:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1583b4f-d49b-54b2-9986-3ee13e10e56f with scrape type 2
2026-03-27 11:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1583b4f-d49b-54b2-9986-3ee13e10e56f, identifier: YB34897
2026-03-27 11:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897
2026-03-27 11:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897
2026-03-27 11:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1583b4f-d49b-54b2-9986-3ee13e10e56f with identifier: YB34897 to the API
2026-03-27 11:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:44:02Z',
 'fuel_type': 'petrol',
 'id': 'f1583b4f-d49b-54b2-9986-3ee13e10e56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB34897',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 173798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-01',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2018}
2026-03-27 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB34897%27 HTTP/1.1" 200 None
2026-03-27 11:37:01 [auto1.be] INFO: Saving data for YB34897: {'auction_closing_time': 1774629842.0, 'created_time': 1774038925.55209, 'last_price_update_time': 1774611421.124016}
2026-03-27 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB34897') HTTP/1.1" 204 0
2026-03-27 11:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:02 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1872 | hits on page: 40
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT44813%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for DT44813: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: GP11824
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: DG23059
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG23059%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for DG23059: 2
2026-03-27 11:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cafbe7b1-63da-5f0b-8c91-f5c213533d55 with identifier: DG23059
2026-03-27 11:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cafbe7b1-63da-5f0b-8c91-f5c213533d55 with scrape type 2
2026-03-27 11:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cafbe7b1-63da-5f0b-8c91-f5c213533d55 with scrape type 2
2026-03-27 11:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cafbe7b1-63da-5f0b-8c91-f5c213533d55, identifier: DG23059
2026-03-27 11:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cafbe7b1-63da-5f0b-8c91-f5c213533d55 with identifier: DG23059
2026-03-27 11:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cafbe7b1-63da-5f0b-8c91-f5c213533d55 with identifier: DG23059
2026-03-27 11:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cafbe7b1-63da-5f0b-8c91-f5c213533d55 with identifier: DG23059 to the API
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:05:36Z',
 'fuel_type': 'petrol',
 'id': 'cafbe7b1-63da-5f0b-8c91-f5c213533d55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG23059',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 104619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG23059%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Saving data for DG23059: {'auction_closing_time': 1774627536.0, 'created_time': 1773239946.032718, 'last_price_update_time': 1774611422.464454}
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DG23059') HTTP/1.1" 204 0
2026-03-27 11:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW50978%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for TW50978: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: UT07504
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT07504%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for UT07504: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP41494%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for SP41494: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE95179%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for CE95179: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: LF65980
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF65980%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for LF65980: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: YP24306
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP24306%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for YP24306: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ35563%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for RJ35563: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG04214%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for CG04214: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for YN20871: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: AS73596
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: LB52674
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: LB99980
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR44504%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for MR44504: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: MG85260
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: HJ68076
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68076%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for HJ68076: 0
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: GB58536
2026-03-27 11:37:02 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-27 11:37:02 [auto1.be] INFO: Scrape type for KM78271: 2
2026-03-27 11:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271
2026-03-27 11:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73c63d67-b840-5d01-83b1-0c68b59f4098 with scrape type 2
2026-03-27 11:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73c63d67-b840-5d01-83b1-0c68b59f4098 with scrape type 2
2026-03-27 11:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73c63d67-b840-5d01-83b1-0c68b59f4098, identifier: KM78271
2026-03-27 11:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271
2026-03-27 11:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271
2026-03-27 11:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73c63d67-b840-5d01-83b1-0c68b59f4098 with identifier: KM78271 to the API
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-27T16:24:47Z',
 'fuel_type': 'petrol',
 'id': '73c63d67-b840-5d01-83b1-0c68b59f4098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM78271',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 137278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-21',
 'seller_name': None,
 'title': 'Volvo V60 1.5 Linje Svart',
 'transmission': 'automatic',
 'trim': 'Linje Svart',
 'year': 2018}
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM78271%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Saving data for KM78271: {'auction_closing_time': 1774628687.0, 'created_time': 1773225325.019378, 'last_price_update_time': 1774611423.108064}
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM78271') HTTP/1.1" 204 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: JV15040
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV15040%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for JV15040: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32342%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for HU32342: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ27954%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for WJ27954: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB89666%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for HB89666: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: EP89086
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP89086%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for EP89086: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for CP45384: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ90658%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for BZ90658: 0
2026-03-27 11:37:03 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE77274%27 HTTP/1.1" 200 None
2026-03-27 11:37:03 [auto1.be] INFO: Scrape type for VE77274: 0
2026-03-27 11:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:04 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1872 | hits on page: 40
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: EW69496
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW69496%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for EW69496: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: SB72599
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NX65189%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for NX65189: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: PM01908
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: HH99253
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH99253%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for HH99253: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: FT14375
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT14375%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for FT14375: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: AG59178
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX76756%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for SX76756: 2
2026-03-27 11:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21983c29-ccf6-537f-8b00-06d5fe67d9a4 with identifier: SX76756
2026-03-27 11:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21983c29-ccf6-537f-8b00-06d5fe67d9a4 with scrape type 2
2026-03-27 11:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21983c29-ccf6-537f-8b00-06d5fe67d9a4 with scrape type 2
2026-03-27 11:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21983c29-ccf6-537f-8b00-06d5fe67d9a4, identifier: SX76756
2026-03-27 11:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21983c29-ccf6-537f-8b00-06d5fe67d9a4 with identifier: SX76756
2026-03-27 11:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21983c29-ccf6-537f-8b00-06d5fe67d9a4 with identifier: SX76756
2026-03-27 11:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21983c29-ccf6-537f-8b00-06d5fe67d9a4 with identifier: SX76756 to the API
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:57:38Z',
 'fuel_type': 'petrol',
 'id': '21983c29-ccf6-537f-8b00-06d5fe67d9a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX76756',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 103536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-14',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX76756%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Saving data for SX76756: {'auction_closing_time': 1774630658.0, 'created_time': 1773866652.107306, 'last_price_update_time': 1774611424.790752}
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX76756') HTTP/1.1" 204 0
2026-03-27 11:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: TK82832
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK82832%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for TK82832: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC35394%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for AC35394: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA95611%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for MA95611: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS30497%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for KS30497: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: BN01077
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN01077%27 HTTP/1.1" 200 None
2026-03-27 11:37:04 [auto1.be] INFO: Scrape type for BN01077: 0
2026-03-27 11:37:04 [auto1.be] INFO: Found listing with ID: FU61214
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU61214%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for FU61214: 0
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: EA51095
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: ZW46984
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW46984%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for ZW46984: 0
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: BD44372
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD44372%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for BD44372: 0
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: TN36699
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN36699%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for TN36699: 0
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW19960%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for EW19960: 0
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: TA69601
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: BL90770
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: ME25565
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: CY39979
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF90058%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for XF90058: 2
2026-03-27 11:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad47983-5e28-5994-8527-8e4c110cf578 with identifier: XF90058
2026-03-27 11:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad47983-5e28-5994-8527-8e4c110cf578 with scrape type 2
2026-03-27 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ad47983-5e28-5994-8527-8e4c110cf578 with scrape type 2
2026-03-27 11:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4ad47983-5e28-5994-8527-8e4c110cf578, identifier: XF90058
2026-03-27 11:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4ad47983-5e28-5994-8527-8e4c110cf578 with identifier: XF90058
2026-03-27 11:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4ad47983-5e28-5994-8527-8e4c110cf578 with identifier: XF90058
2026-03-27 11:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4ad47983-5e28-5994-8527-8e4c110cf578 with identifier: XF90058 to the API
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-27T16:53:36Z',
 'fuel_type': 'diesel',
 'id': '4ad47983-5e28-5994-8527-8e4c110cf578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF90058',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 77143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 Autobiography Dynamic',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2014}
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF90058%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Saving data for XF90058: {'auction_closing_time': 1774630416.0, 'created_time': 1773134172.058935, 'last_price_update_time': 1774611425.543107}
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XF90058') HTTP/1.1" 204 0
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: EA43568
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: UR56668
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-27 11:37:05 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY27857%27 HTTP/1.1" 200 None
2026-03-27 11:37:05 [auto1.be] INFO: Scrape type for ZY27857: 0
2026-03-27 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:06 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 28 pages/min), scraped 137 items (at 73 items/min)
2026-03-27 11:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 11:37:06 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1872 | hits on page: 40
2026-03-27 11:37:06 [auto1.be] INFO: Found listing with ID: ZT60754
2026-03-27 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT60754%27 HTTP/1.1" 200 None
2026-03-27 11:37:06 [auto1.be] INFO: Scrape type for ZT60754: 0
2026-03-27 11:37:06 [auto1.be] INFO: Found listing with ID: NH53756
2026-03-27 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH53756%27 HTTP/1.1" 200 None
2026-03-27 11:37:06 [auto1.be] INFO: Scrape type for NH53756: 2
2026-03-27 11:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7561d8-dc12-573c-be51-81b9754dc897 with identifier: NH53756
2026-03-27 11:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7561d8-dc12-573c-be51-81b9754dc897 with scrape type 2
2026-03-27 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7561d8-dc12-573c-be51-81b9754dc897 with scrape type 2
2026-03-27 11:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb7561d8-dc12-573c-be51-81b9754dc897, identifier: NH53756
2026-03-27 11:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb7561d8-dc12-573c-be51-81b9754dc897 with identifier: NH53756
2026-03-27 11:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb7561d8-dc12-573c-be51-81b9754dc897 with identifier: NH53756
2026-03-27 11:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb7561d8-dc12-573c-be51-81b9754dc897 with identifier: NH53756 to the API
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-27T16:41:42Z',
 'fuel_type': 'petrol',
 'id': 'cb7561d8-dc12-573c-be51-81b9754dc897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH53756',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 10501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH53756%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Saving data for NH53756: {'auction_closing_time': 1774629702.0, 'created_time': 1773348977.403536, 'last_price_update_time': 1774611427.233361}
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH53756') HTTP/1.1" 204 0
2026-03-27 11:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: XC26287
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: GD45895
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: AT93174
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT93174%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for AT93174: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: WX47366
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: XS40132
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT74022%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for XT74022: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: BR56000
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR56000%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for BR56000: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE98600%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for GE98600: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: XC86305
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC86305%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for XC86305: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: DM10374
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY53822%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for DY53822: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: FH43891
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: WM23056
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM23056%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for WM23056: 2
2026-03-27 11:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48a1f32-0490-5343-be16-16fb65815677 with identifier: WM23056
2026-03-27 11:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a1f32-0490-5343-be16-16fb65815677 with scrape type 2
2026-03-27 11:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48a1f32-0490-5343-be16-16fb65815677 with scrape type 2
2026-03-27 11:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f48a1f32-0490-5343-be16-16fb65815677, identifier: WM23056
2026-03-27 11:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f48a1f32-0490-5343-be16-16fb65815677 with identifier: WM23056
2026-03-27 11:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f48a1f32-0490-5343-be16-16fb65815677 with identifier: WM23056
2026-03-27 11:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f48a1f32-0490-5343-be16-16fb65815677 with identifier: WM23056 to the API
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:36:24Z',
 'fuel_type': 'petrol',
 'id': 'f48a1f32-0490-5343-be16-16fb65815677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM23056',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 170561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-01',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 2007}
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM23056%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Saving data for WM23056: {'auction_closing_time': 1774629384.0, 'created_time': 1774341352.53087, 'last_price_update_time': 1774611427.804238}
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM23056') HTTP/1.1" 204 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML32022%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for ML32022: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: WR44467
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF63760%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for NF63760: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: UX70037
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX70037%27 HTTP/1.1" 200 None
2026-03-27 11:37:07 [auto1.be] INFO: Scrape type for UX70037: 0
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: ST35840
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: TE87382
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: AK14209
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: YK73826
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: LG17497
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: TZ22739
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-27 11:37:07 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-27 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL95058%27 HTTP/1.1" 200 None
2026-03-27 11:37:08 [auto1.be] INFO: Scrape type for YL95058: 0
2026-03-27 11:37:08 [auto1.be] INFO: Found listing with ID: NP87608
2026-03-27 11:37:08 [auto1.be] INFO: Found listing with ID: AJ66788
2026-03-27 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ66788%27 HTTP/1.1" 200 None
2026-03-27 11:37:08 [auto1.be] INFO: Scrape type for AJ66788: 0
2026-03-27 11:37:08 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-27 11:37:08 [auto1.be] INFO: Found listing with ID: VR94572
2026-03-27 11:37:08 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-27 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD12029%27 HTTP/1.1" 200 None
2026-03-27 11:37:08 [auto1.be] INFO: Scrape type for RD12029: 0
2026-03-27 11:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:09 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1872 | hits on page: 40
2026-03-27 11:37:09 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-27 11:37:09 [auto1.be] INFO: Scrape type for WT96819: 2
2026-03-27 11:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819
2026-03-27 11:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62be18b7-9493-5c34-bef7-506b1a42f88b with scrape type 2
2026-03-27 11:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62be18b7-9493-5c34-bef7-506b1a42f88b with scrape type 2
2026-03-27 11:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 62be18b7-9493-5c34-bef7-506b1a42f88b, identifier: WT96819
2026-03-27 11:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819
2026-03-27 11:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819
2026-03-27 11:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 62be18b7-9493-5c34-bef7-506b1a42f88b with identifier: WT96819 to the API
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:05:01Z',
 'fuel_type': 'diesel',
 'id': '62be18b7-9493-5c34-bef7-506b1a42f88b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT96819',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 172852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 2,7t Authentique',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t Authentique',
 'year': 2013}
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT96819%27 HTTP/1.1" 200 None
2026-03-27 11:37:09 [auto1.be] INFO: Saving data for WT96819: {'auction_closing_time': 1774627501.0, 'created_time': 1774427754.140828, 'last_price_update_time': 1774611429.45334}
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT96819') HTTP/1.1" 204 0
2026-03-27 11:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:09 [auto1.be] INFO: Found listing with ID: FE85433
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE85433%27 HTTP/1.1" 200 None
2026-03-27 11:37:09 [auto1.be] INFO: Scrape type for FE85433: 0
2026-03-27 11:37:09 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-27 11:37:09 [auto1.be] INFO: Found listing with ID: AU97754
2026-03-27 11:37:09 [auto1.be] INFO: Found listing with ID: YD98254
2026-03-27 11:37:09 [auto1.be] INFO: Found listing with ID: EJ73890
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ73890%27 HTTP/1.1" 200 None
2026-03-27 11:37:09 [auto1.be] INFO: Scrape type for EJ73890: 2
2026-03-27 11:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792557f7-b51d-5723-8d3a-a2b25afcf50b with identifier: EJ73890
2026-03-27 11:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792557f7-b51d-5723-8d3a-a2b25afcf50b with scrape type 2
2026-03-27 11:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792557f7-b51d-5723-8d3a-a2b25afcf50b with scrape type 2
2026-03-27 11:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 792557f7-b51d-5723-8d3a-a2b25afcf50b, identifier: EJ73890
2026-03-27 11:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 792557f7-b51d-5723-8d3a-a2b25afcf50b with identifier: EJ73890
2026-03-27 11:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 792557f7-b51d-5723-8d3a-a2b25afcf50b with identifier: EJ73890
2026-03-27 11:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 792557f7-b51d-5723-8d3a-a2b25afcf50b with identifier: EJ73890 to the API
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:42:16Z',
 'fuel_type': 'diesel',
 'id': '792557f7-b51d-5723-8d3a-a2b25afcf50b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ73890',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 224267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2018}
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ73890%27 HTTP/1.1" 200 None
2026-03-27 11:37:09 [auto1.be] INFO: Saving data for EJ73890: {'auction_closing_time': 1774629736.0, 'created_time': 1774427757.668177, 'last_price_update_time': 1774611429.986127}
2026-03-27 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ73890') HTTP/1.1" 204 0
2026-03-27 11:37:10 [auto1.be] INFO: Found listing with ID: LT40648
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT40648%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Scrape type for LT40648: 0
2026-03-27 11:37:10 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Scrape type for ZC75548: 2
2026-03-27 11:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548
2026-03-27 11:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with scrape type 2
2026-03-27 11:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with scrape type 2
2026-03-27 11:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e8969eab-8dc6-5b82-8445-d3e575ac6fa2, identifier: ZC75548
2026-03-27 11:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548
2026-03-27 11:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548
2026-03-27 11:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e8969eab-8dc6-5b82-8445-d3e575ac6fa2 with identifier: ZC75548 to the API
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-27T16:08:42Z',
 'fuel_type': 'petrol',
 'id': 'e8969eab-8dc6-5b82-8445-d3e575ac6fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC75548',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 71470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2017}
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC75548%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Saving data for ZC75548: {'auction_closing_time': 1774627722.0, 'created_time': 1774427752.383658, 'last_price_update_time': 1774611430.433945}
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC75548') HTTP/1.1" 204 0
2026-03-27 11:37:10 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-27 11:37:10 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-27 11:37:10 [auto1.be] INFO: Found listing with ID: ET36729
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET36729%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Scrape type for ET36729: 0
2026-03-27 11:37:10 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Scrape type for DF09339: 2
2026-03-27 11:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-27 11:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca9d3055-ca4d-5125-827c-f168fc7891c6 with scrape type 2
2026-03-27 11:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca9d3055-ca4d-5125-827c-f168fc7891c6 with scrape type 2
2026-03-27 11:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca9d3055-ca4d-5125-827c-f168fc7891c6, identifier: DF09339
2026-03-27 11:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-27 11:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339
2026-03-27 11:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca9d3055-ca4d-5125-827c-f168fc7891c6 with identifier: DF09339 to the API
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:32:22Z',
 'fuel_type': 'diesel',
 'id': 'ca9d3055-ca4d-5125-827c-f168fc7891c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF09339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 92653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-18',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2019}
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-27 11:37:10 [auto1.be] INFO: Saving data for DF09339: {'auction_closing_time': 1774629142.0, 'created_time': 1774341336.667129, 'last_price_update_time': 1774611430.941909}
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF09339') HTTP/1.1" 204 0
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: JT53562
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT53562%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Scrape type for JT53562: 2
2026-03-27 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562
2026-03-27 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with scrape type 2
2026-03-27 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with scrape type 2
2026-03-27 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31, identifier: JT53562
2026-03-27 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562
2026-03-27 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562
2026-03-27 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562 to the API
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:17:41Z',
 'fuel_type': 'petrol',
 'id': '5d7351ae-b6ec-57b8-a833-bc2ce9635e31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT53562',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 135731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-07',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT53562%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Saving data for JT53562: {'auction_closing_time': 1774628261.0, 'created_time': 1773228008.856981, 'last_price_update_time': 1774611431.46924}
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT53562') HTTP/1.1" 204 0
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: FE67776
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: JA35484
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA35484%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Scrape type for JA35484: 0
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: JP36174
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP36174%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Scrape type for JP36174: 0
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: RU23480
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: FB99021
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB99021%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Scrape type for FB99021: 0
2026-03-27 11:37:11 [auto1.be] INFO: Found listing with ID: UD45349
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD45349%27 HTTP/1.1" 200 None
2026-03-27 11:37:11 [auto1.be] INFO: Scrape type for UD45349: 2
2026-03-27 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b26e9f9b-381a-5237-a411-96d1115ecbda with identifier: UD45349
2026-03-27 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b26e9f9b-381a-5237-a411-96d1115ecbda with scrape type 2
2026-03-27 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b26e9f9b-381a-5237-a411-96d1115ecbda with scrape type 2
2026-03-27 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b26e9f9b-381a-5237-a411-96d1115ecbda, identifier: UD45349
2026-03-27 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b26e9f9b-381a-5237-a411-96d1115ecbda with identifier: UD45349
2026-03-27 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b26e9f9b-381a-5237-a411-96d1115ecbda with identifier: UD45349
2026-03-27 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b26e9f9b-381a-5237-a411-96d1115ecbda with identifier: UD45349 to the API
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:09:21Z',
 'fuel_type': 'petrol',
 'id': 'b26e9f9b-381a-5237-a411-96d1115ecbda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD45349',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 148963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-03-27 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD45349%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Saving data for UD45349: {'auction_closing_time': 1774627761.0, 'created_time': 1773953444.299716, 'last_price_update_time': 1774611432.00771}
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD45349') HTTP/1.1" 204 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: AX50083
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX50083%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for AX50083: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: XM90245
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM90245%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for XM90245: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: UW02505
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL48181%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for ZL48181: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP65458%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for VP65458: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: CG87978
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for HW03040: 2
2026-03-27 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040
2026-03-27 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768ff7d3-76f0-5859-88cb-1f4834073b18 with scrape type 2
2026-03-27 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768ff7d3-76f0-5859-88cb-1f4834073b18 with scrape type 2
2026-03-27 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 768ff7d3-76f0-5859-88cb-1f4834073b18, identifier: HW03040
2026-03-27 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040
2026-03-27 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040
2026-03-27 11:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 768ff7d3-76f0-5859-88cb-1f4834073b18 with identifier: HW03040 to the API
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:07:59Z',
 'fuel_type': 'diesel',
 'id': '768ff7d3-76f0-5859-88cb-1f4834073b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW03040',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 253404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW03040%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Saving data for HW03040: {'auction_closing_time': 1774627679.0, 'created_time': 1773693916.614651, 'last_price_update_time': 1774611432.520711}
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW03040') HTTP/1.1" 204 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: EM93050
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC12895%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for YC12895: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR59169%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for GR59169: 0
2026-03-27 11:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:12 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1872 | hits on page: 40
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: VH76362
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH76362%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for VH76362: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ29729%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for PJ29729: 0
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: NX44196
2026-03-27 11:37:12 [auto1.be] INFO: Found listing with ID: NJ72085
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ72085%27 HTTP/1.1" 200 None
2026-03-27 11:37:12 [auto1.be] INFO: Scrape type for NJ72085: 2
2026-03-27 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed3011e-216a-50ad-a254-3415a126168b with identifier: NJ72085
2026-03-27 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed3011e-216a-50ad-a254-3415a126168b with scrape type 2
2026-03-27 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bed3011e-216a-50ad-a254-3415a126168b with scrape type 2
2026-03-27 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bed3011e-216a-50ad-a254-3415a126168b, identifier: NJ72085
2026-03-27 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bed3011e-216a-50ad-a254-3415a126168b with identifier: NJ72085
2026-03-27 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bed3011e-216a-50ad-a254-3415a126168b with identifier: NJ72085
2026-03-27 11:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bed3011e-216a-50ad-a254-3415a126168b with identifier: NJ72085 to the API
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:50:59Z',
 'fuel_type': 'petrol',
 'id': 'bed3011e-216a-50ad-a254-3415a126168b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ72085',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2018}
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ72085%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Saving data for NJ72085: {'auction_closing_time': 1774630259.0, 'created_time': 1773301933.081687, 'last_price_update_time': 1774611433.292579}
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ72085') HTTP/1.1" 204 0
2026-03-27 11:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: XV08295
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV08295%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for XV08295: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV64637%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for ZV64637: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: DF67352
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF67352%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for DF67352: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: RB68034
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA31821%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for YA31821: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: YK30671
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK30671%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for YK30671: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: JU50547
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: HL07248
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: SL75096
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: XE24003
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE24003%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for XE24003: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD10151%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for DD10151: 0
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: EA43417
2026-03-27 11:37:13 [auto1.be] INFO: Found listing with ID: BF19494
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF19494%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Scrape type for BF19494: 2
2026-03-27 11:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e39e95-049d-5cc3-8fe4-55f0664cc132 with identifier: BF19494
2026-03-27 11:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e39e95-049d-5cc3-8fe4-55f0664cc132 with scrape type 2
2026-03-27 11:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4e39e95-049d-5cc3-8fe4-55f0664cc132 with scrape type 2
2026-03-27 11:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4e39e95-049d-5cc3-8fe4-55f0664cc132, identifier: BF19494
2026-03-27 11:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4e39e95-049d-5cc3-8fe4-55f0664cc132 with identifier: BF19494
2026-03-27 11:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4e39e95-049d-5cc3-8fe4-55f0664cc132 with identifier: BF19494
2026-03-27 11:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4e39e95-049d-5cc3-8fe4-55f0664cc132 with identifier: BF19494 to the API
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:49:29Z',
 'fuel_type': 'petrol',
 'id': 'e4e39e95-049d-5cc3-8fe4-55f0664cc132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF19494',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 193772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF19494%27 HTTP/1.1" 200 None
2026-03-27 11:37:13 [auto1.be] INFO: Saving data for BF19494: {'auction_closing_time': 1774630169.0, 'created_time': 1774341349.775232, 'last_price_update_time': 1774611433.976082}
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BF19494') HTTP/1.1" 204 0
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-27 11:37:14 [auto1.be] INFO: Scrape type for YS75558: 2
2026-03-27 11:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558
2026-03-27 11:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a127bb04-5a98-5f4f-8b7e-025b2874ac21 with scrape type 2
2026-03-27 11:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a127bb04-5a98-5f4f-8b7e-025b2874ac21 with scrape type 2
2026-03-27 11:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a127bb04-5a98-5f4f-8b7e-025b2874ac21, identifier: YS75558
2026-03-27 11:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558
2026-03-27 11:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558
2026-03-27 11:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558 to the API
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:59:22Z',
 'fuel_type': 'diesel',
 'id': 'a127bb04-5a98-5f4f-8b7e-025b2874ac21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS75558',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 239776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-13',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2012}
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-27 11:37:14 [auto1.be] INFO: Saving data for YS75558: {'auction_closing_time': 1774630762.0, 'created_time': 1773693736.870881, 'last_price_update_time': 1774611434.506018}
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS75558') HTTP/1.1" 204 0
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: PE81992
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE81992%27 HTTP/1.1" 200 None
2026-03-27 11:37:14 [auto1.be] INFO: Scrape type for PE81992: 0
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: CT32592
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT32592%27 HTTP/1.1" 200 None
2026-03-27 11:37:14 [auto1.be] INFO: Scrape type for CT32592: 0
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: AR89710
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK71488%27 HTTP/1.1" 200 None
2026-03-27 11:37:14 [auto1.be] INFO: Scrape type for CK71488: 2
2026-03-27 11:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e481309-efec-5df0-acb6-cda99e64e879 with identifier: CK71488
2026-03-27 11:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e481309-efec-5df0-acb6-cda99e64e879 with scrape type 2
2026-03-27 11:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e481309-efec-5df0-acb6-cda99e64e879 with scrape type 2
2026-03-27 11:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e481309-efec-5df0-acb6-cda99e64e879, identifier: CK71488
2026-03-27 11:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e481309-efec-5df0-acb6-cda99e64e879 with identifier: CK71488
2026-03-27 11:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e481309-efec-5df0-acb6-cda99e64e879 with identifier: CK71488
2026-03-27 11:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e481309-efec-5df0-acb6-cda99e64e879 with identifier: CK71488 to the API
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:55:19Z',
 'fuel_type': 'diesel',
 'id': '7e481309-efec-5df0-acb6-cda99e64e879',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK71488',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 184683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK71488%27 HTTP/1.1" 200 None
2026-03-27 11:37:14 [auto1.be] INFO: Saving data for CK71488: {'auction_closing_time': 1774630519.0, 'created_time': 1774039020.538362, 'last_price_update_time': 1774611434.973567}
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK71488') HTTP/1.1" 204 0
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-27 11:37:14 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ84188%27 HTTP/1.1" 200 None
2026-03-27 11:37:15 [auto1.be] INFO: Scrape type for UJ84188: 0
2026-03-27 11:37:15 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB85934%27 HTTP/1.1" 200 None
2026-03-27 11:37:15 [auto1.be] INFO: Scrape type for GB85934: 0
2026-03-27 11:37:15 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-27 11:37:15 [auto1.be] INFO: Found listing with ID: LB43860
2026-03-27 11:37:15 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-27 11:37:15 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-27 11:37:15 [auto1.be] INFO: Scrape type for JC58807: 2
2026-03-27 11:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807
2026-03-27 11:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with scrape type 2
2026-03-27 11:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with scrape type 2
2026-03-27 11:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049, identifier: JC58807
2026-03-27 11:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807
2026-03-27 11:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807
2026-03-27 11:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049 with identifier: JC58807 to the API
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:01:12Z',
 'fuel_type': 'diesel',
 'id': 'bb6f5b1a-9fbc-5dd9-b8fa-e38caad39049',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC58807',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 119830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2017}
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-27 11:37:15 [auto1.be] INFO: Saving data for JC58807: {'auction_closing_time': 1774627272.0, 'created_time': 1773132177.722838, 'last_price_update_time': 1774611435.582763}
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC58807') HTTP/1.1" 204 0
2026-03-27 11:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:16 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC58807%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Scrape type for JC58807: 0
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: JT22008
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: UA15007
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA15007%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Scrape type for UA15007: 0
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: PC72371
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC72371%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Scrape type for PC72371: 0
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: YX77008
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: YZ45522
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED62480%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Scrape type for ED62480: 0
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: SK00862
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK00862%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Scrape type for SK00862: 0
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Scrape type for NJ53644: 2
2026-03-27 11:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-27 11:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44623cf2-fece-58a6-9429-68a52afad111 with scrape type 2
2026-03-27 11:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44623cf2-fece-58a6-9429-68a52afad111 with scrape type 2
2026-03-27 11:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44623cf2-fece-58a6-9429-68a52afad111, identifier: NJ53644
2026-03-27 11:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-27 11:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-27 11:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644 to the API
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:22:52Z',
 'fuel_type': 'diesel',
 'id': '44623cf2-fece-58a6-9429-68a52afad111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ53644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 215236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-01',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2015}
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-27 11:37:16 [auto1.be] INFO: Saving data for NJ53644: {'auction_closing_time': 1774628572.0, 'created_time': 1773133167.364383, 'last_price_update_time': 1774611436.884303}
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ53644') HTTP/1.1" 204 0
2026-03-27 11:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: PU00884
2026-03-27 11:37:16 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN66713%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for CN66713: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: BP55098
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP55098%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for BP55098: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY53321%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for ZY53321: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH29158%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for NH29158: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR81556%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for LR81556: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: GN30900
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for JZ31869: 2
2026-03-27 11:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869
2026-03-27 11:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05701f22-1ae1-5234-9244-c64b3f17a6e1 with scrape type 2
2026-03-27 11:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05701f22-1ae1-5234-9244-c64b3f17a6e1 with scrape type 2
2026-03-27 11:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 05701f22-1ae1-5234-9244-c64b3f17a6e1, identifier: JZ31869
2026-03-27 11:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869
2026-03-27 11:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869
2026-03-27 11:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 05701f22-1ae1-5234-9244-c64b3f17a6e1 with identifier: JZ31869 to the API
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:28:46Z',
 'fuel_type': 'petrol',
 'id': '05701f22-1ae1-5234-9244-c64b3f17a6e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ31869',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 133471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ31869%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Saving data for JZ31869: {'auction_closing_time': 1774628926.0, 'created_time': 1773693830.126407, 'last_price_update_time': 1774611437.545426}
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ31869') HTTP/1.1" 204 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP73132%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for EP73132: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: CF18791
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: VW96598
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW96598%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for VW96598: 0
2026-03-27 11:37:17 [auto1.be] INFO: Found listing with ID: AE79510
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE79510%27 HTTP/1.1" 200 None
2026-03-27 11:37:17 [auto1.be] INFO: Scrape type for AE79510: 2
2026-03-27 11:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c73f129-44a2-51a0-952d-864243606d77 with identifier: AE79510
2026-03-27 11:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c73f129-44a2-51a0-952d-864243606d77 with scrape type 2
2026-03-27 11:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c73f129-44a2-51a0-952d-864243606d77 with scrape type 2
2026-03-27 11:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c73f129-44a2-51a0-952d-864243606d77, identifier: AE79510
2026-03-27 11:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c73f129-44a2-51a0-952d-864243606d77 with identifier: AE79510
2026-03-27 11:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c73f129-44a2-51a0-952d-864243606d77 with identifier: AE79510
2026-03-27 11:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c73f129-44a2-51a0-952d-864243606d77 with identifier: AE79510 to the API
2026-03-27 11:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:23:06Z',
 'fuel_type': 'diesel',
 'id': '2c73f129-44a2-51a0-952d-864243606d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE79510',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 143240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-22',
 'seller_name': None,
 'title': 'Mazda 5 1.6 CD Diesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE79510%27 HTTP/1.1" 200 None
2026-03-27 11:37:18 [auto1.be] INFO: Saving data for AE79510: {'auction_closing_time': 1774628586.0, 'created_time': 1773134482.910572, 'last_price_update_time': 1774611438.117474}
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AE79510') HTTP/1.1" 204 0
2026-03-27 11:37:18 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL40552%27 HTTP/1.1" 200 None
2026-03-27 11:37:18 [auto1.be] INFO: Scrape type for JL40552: 0
2026-03-27 11:37:18 [auto1.be] INFO: Found listing with ID: HE73926
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE73926%27 HTTP/1.1" 200 None
2026-03-27 11:37:18 [auto1.be] INFO: Scrape type for HE73926: 0
2026-03-27 11:37:18 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-27 11:37:18 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-27 11:37:18 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84534%27 HTTP/1.1" 200 None
2026-03-27 11:37:18 [auto1.be] INFO: Scrape type for BR84534: 0
2026-03-27 11:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:19 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: FN85059
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN85059%27 HTTP/1.1" 200 None
2026-03-27 11:37:19 [auto1.be] INFO: Scrape type for FN85059: 2
2026-03-27 11:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900b61a7-55e4-5e4e-a5be-dd88f5d343a0 with identifier: FN85059
2026-03-27 11:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900b61a7-55e4-5e4e-a5be-dd88f5d343a0 with scrape type 2
2026-03-27 11:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 900b61a7-55e4-5e4e-a5be-dd88f5d343a0 with scrape type 2
2026-03-27 11:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 900b61a7-55e4-5e4e-a5be-dd88f5d343a0, identifier: FN85059
2026-03-27 11:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 900b61a7-55e4-5e4e-a5be-dd88f5d343a0 with identifier: FN85059
2026-03-27 11:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 900b61a7-55e4-5e4e-a5be-dd88f5d343a0 with identifier: FN85059
2026-03-27 11:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 900b61a7-55e4-5e4e-a5be-dd88f5d343a0 with identifier: FN85059 to the API
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:14:22Z',
 'fuel_type': 'diesel',
 'id': '900b61a7-55e4-5e4e-a5be-dd88f5d343a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN85059',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 220772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN85059%27 HTTP/1.1" 200 None
2026-03-27 11:37:19 [auto1.be] INFO: Saving data for FN85059: {'auction_closing_time': 1774628062.0, 'created_time': 1773953231.993811, 'last_price_update_time': 1774611439.73893}
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN85059') HTTP/1.1" 204 0
2026-03-27 11:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: TA14321
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA14321%27 HTTP/1.1" 200 None
2026-03-27 11:37:19 [auto1.be] INFO: Scrape type for TA14321: 0
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: HJ60964
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ60964%27 HTTP/1.1" 200 None
2026-03-27 11:37:19 [auto1.be] INFO: Scrape type for HJ60964: 0
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: AR12045
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AR12045%27 HTTP/1.1" 200 None
2026-03-27 11:37:19 [auto1.be] INFO: Scrape type for AR12045: 0
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: BY03861
2026-03-27 11:37:19 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-27 11:37:19 [auto1.be] INFO: Scrape type for VW71513: 2
2026-03-27 11:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-27 11:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2953698-693a-5e57-87e1-b5a5fb178847 with scrape type 2
2026-03-27 11:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2953698-693a-5e57-87e1-b5a5fb178847 with scrape type 2
2026-03-27 11:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2953698-693a-5e57-87e1-b5a5fb178847, identifier: VW71513
2026-03-27 11:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-27 11:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-27 11:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513 to the API
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-27T16:09:41Z',
 'fuel_type': 'petrol',
 'id': 'e2953698-693a-5e57-87e1-b5a5fb178847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW71513',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 145941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'Audi A7 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Saving data for VW71513: {'auction_closing_time': 1774627781.0, 'created_time': 1773693872.113411, 'last_price_update_time': 1774611440.350202}
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW71513') HTTP/1.1" 204 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV03405%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for TV03405: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ37534%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for YJ37534: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK27252%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for VK27252: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: RN01918
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN01918%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for RN01918: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: CY42918
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX22691%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for PX22691: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS89988%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for DS89988: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: BX14105
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX14105%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for BX14105: 0
2026-03-27 11:37:20 [auto1.be] INFO: Found listing with ID: YC56497
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC56497%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Scrape type for YC56497: 2
2026-03-27 11:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eaef15e-5dfe-512b-818c-a63475f7e8f9 with identifier: YC56497
2026-03-27 11:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eaef15e-5dfe-512b-818c-a63475f7e8f9 with scrape type 2
2026-03-27 11:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eaef15e-5dfe-512b-818c-a63475f7e8f9 with scrape type 2
2026-03-27 11:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7eaef15e-5dfe-512b-818c-a63475f7e8f9, identifier: YC56497
2026-03-27 11:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7eaef15e-5dfe-512b-818c-a63475f7e8f9 with identifier: YC56497
2026-03-27 11:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7eaef15e-5dfe-512b-818c-a63475f7e8f9 with identifier: YC56497
2026-03-27 11:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7eaef15e-5dfe-512b-818c-a63475f7e8f9 with identifier: YC56497 to the API
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:15:48Z',
 'fuel_type': 'petrol',
 'id': '7eaef15e-5dfe-512b-818c-a63475f7e8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC56497',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 210890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-10',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2009}
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC56497%27 HTTP/1.1" 200 None
2026-03-27 11:37:20 [auto1.be] INFO: Saving data for YC56497: {'auction_closing_time': 1774628148.0, 'created_time': 1774341346.019248, 'last_price_update_time': 1774611440.951168}
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC56497') HTTP/1.1" 204 0
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP19111%27 HTTP/1.1" 200 None
2026-03-27 11:37:21 [auto1.be] INFO: Scrape type for SP19111: 2
2026-03-27 11:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1dec465-f760-5661-ac4c-0c722e00f9ea with identifier: SP19111
2026-03-27 11:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1dec465-f760-5661-ac4c-0c722e00f9ea with scrape type 2
2026-03-27 11:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1dec465-f760-5661-ac4c-0c722e00f9ea with scrape type 2
2026-03-27 11:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1dec465-f760-5661-ac4c-0c722e00f9ea, identifier: SP19111
2026-03-27 11:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1dec465-f760-5661-ac4c-0c722e00f9ea with identifier: SP19111
2026-03-27 11:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1dec465-f760-5661-ac4c-0c722e00f9ea with identifier: SP19111
2026-03-27 11:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1dec465-f760-5661-ac4c-0c722e00f9ea with identifier: SP19111 to the API
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:38:29Z',
 'fuel_type': 'diesel',
 'id': 'c1dec465-f760-5661-ac4c-0c722e00f9ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP19111',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 107055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP19111%27 HTTP/1.1" 200 None
2026-03-27 11:37:21 [auto1.be] INFO: Saving data for SP19111: {'auction_closing_time': 1774629509.0, 'created_time': 1773134701.244333, 'last_price_update_time': 1774611441.486972}
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP19111') HTTP/1.1" 204 0
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: RF85540
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: SY57103
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY57103%27 HTTP/1.1" 200 None
2026-03-27 11:37:21 [auto1.be] INFO: Scrape type for SY57103: 0
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: YD10614
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-27 11:37:21 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: RK47146
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: RT59839
2026-03-27 11:37:21 [auto1.be] INFO: Found listing with ID: MN62263
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN62263%27 HTTP/1.1" 200 None
2026-03-27 11:37:21 [auto1.be] INFO: Scrape type for MN62263: 2
2026-03-27 11:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2810b00-9b33-5af1-a2bc-a88c911bcec9 with identifier: MN62263
2026-03-27 11:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2810b00-9b33-5af1-a2bc-a88c911bcec9 with scrape type 2
2026-03-27 11:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2810b00-9b33-5af1-a2bc-a88c911bcec9 with scrape type 2
2026-03-27 11:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2810b00-9b33-5af1-a2bc-a88c911bcec9, identifier: MN62263
2026-03-27 11:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2810b00-9b33-5af1-a2bc-a88c911bcec9 with identifier: MN62263
2026-03-27 11:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2810b00-9b33-5af1-a2bc-a88c911bcec9 with identifier: MN62263
2026-03-27 11:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2810b00-9b33-5af1-a2bc-a88c911bcec9 with identifier: MN62263 to the API
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:51:11Z',
 'fuel_type': 'petrol',
 'id': 'c2810b00-9b33-5af1-a2bc-a88c911bcec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN62263',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 32974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-13',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Journey',
 'transmission': 'manual',
 'trim': 'Journey',
 'year': 2023}
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN62263%27 HTTP/1.1" 200 None
2026-03-27 11:37:21 [auto1.be] INFO: Saving data for MN62263: {'auction_closing_time': 1774630271.0, 'created_time': 1774341348.871686, 'last_price_update_time': 1774611441.970579}
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MN62263') HTTP/1.1" 204 0
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-27 11:37:22 [auto1.be] INFO: Scrape type for HS04385: 2
2026-03-27 11:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385
2026-03-27 11:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a836947a-3d99-545e-8faa-11bc37e87ffc with scrape type 2
2026-03-27 11:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a836947a-3d99-545e-8faa-11bc37e87ffc with scrape type 2
2026-03-27 11:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a836947a-3d99-545e-8faa-11bc37e87ffc, identifier: HS04385
2026-03-27 11:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385
2026-03-27 11:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385
2026-03-27 11:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a836947a-3d99-545e-8faa-11bc37e87ffc with identifier: HS04385 to the API
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:19:43Z',
 'fuel_type': 'diesel',
 'id': 'a836947a-3d99-545e-8faa-11bc37e87ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS04385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 182322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2018}
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS04385%27 HTTP/1.1" 200 None
2026-03-27 11:37:22 [auto1.be] INFO: Saving data for HS04385: {'auction_closing_time': 1774628383.0, 'created_time': 1773780039.807142, 'last_price_update_time': 1774611442.510588}
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS04385') HTTP/1.1" 204 0
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: GH90651
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH90651%27 HTTP/1.1" 200 None
2026-03-27 11:37:22 [auto1.be] INFO: Scrape type for GH90651: 0
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB21597%27 HTTP/1.1" 200 None
2026-03-27 11:37:22 [auto1.be] INFO: Scrape type for RB21597: 0
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: MX18296
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX18296%27 HTTP/1.1" 200 None
2026-03-27 11:37:22 [auto1.be] INFO: Scrape type for MX18296: 0
2026-03-27 11:37:22 [auto1.be] INFO: Found listing with ID: JE21822
2026-03-27 11:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:23 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: MD01778
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for SR71847: 2
2026-03-27 11:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-27 11:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01837aeb-71bd-5171-ac3c-963900840840 with scrape type 2
2026-03-27 11:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01837aeb-71bd-5171-ac3c-963900840840 with scrape type 2
2026-03-27 11:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01837aeb-71bd-5171-ac3c-963900840840, identifier: SR71847
2026-03-27 11:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-27 11:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-27 11:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847 to the API
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-27T16:20:47Z',
 'fuel_type': 'petrol',
 'id': '01837aeb-71bd-5171-ac3c-963900840840',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR71847',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 74167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-01',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Saving data for SR71847: {'auction_closing_time': 1774628447.0, 'created_time': 1773301671.47644, 'last_price_update_time': 1774611443.74356}
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR71847') HTTP/1.1" 204 0
2026-03-27 11:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: KZ42002
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for CD50328: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for SJ72272: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK31036%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for XK31036: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: CX55361
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX55361%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for CX55361: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: GM39881
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM39881%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for GM39881: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: VN59919
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VN59919%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for VN59919: 0
2026-03-27 11:37:23 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF40273%27 HTTP/1.1" 200 None
2026-03-27 11:37:23 [auto1.be] INFO: Scrape type for YF40273: 2
2026-03-27 11:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad98d363-f2f7-5a9b-8521-d344d3d2a944 with identifier: YF40273
2026-03-27 11:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad98d363-f2f7-5a9b-8521-d344d3d2a944 with scrape type 2
2026-03-27 11:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad98d363-f2f7-5a9b-8521-d344d3d2a944 with scrape type 2
2026-03-27 11:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad98d363-f2f7-5a9b-8521-d344d3d2a944, identifier: YF40273
2026-03-27 11:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad98d363-f2f7-5a9b-8521-d344d3d2a944 with identifier: YF40273
2026-03-27 11:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad98d363-f2f7-5a9b-8521-d344d3d2a944 with identifier: YF40273
2026-03-27 11:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad98d363-f2f7-5a9b-8521-d344d3d2a944 with identifier: YF40273 to the API
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:56:11Z',
 'fuel_type': 'diesel',
 'id': 'ad98d363-f2f7-5a9b-8521-d344d3d2a944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF40273',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 131826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF40273%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Saving data for YF40273: {'auction_closing_time': 1774630571.0, 'created_time': 1774427755.348868, 'last_price_update_time': 1774611444.39091}
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF40273') HTTP/1.1" 204 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: MH02888
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH02888%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for MH02888: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: FE12060
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE12060%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for FE12060: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK31159%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for DK31159: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: YK88135
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK88135%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for YK88135: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: BP92313
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP92313%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for BP92313: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: TU22129
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL97420%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for TL97420: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: BL91672
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL91672%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for BL91672: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: KH42245
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: TH56749
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB55394%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for LB55394: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: GZ41273
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT93863%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for PT93863: 0
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-27 11:37:24 [auto1.be] INFO: Found listing with ID: BL25220
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL25220%27 HTTP/1.1" 200 None
2026-03-27 11:37:24 [auto1.be] INFO: Scrape type for BL25220: 2
2026-03-27 11:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c with identifier: BL25220
2026-03-27 11:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c with scrape type 2
2026-03-27 11:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c with scrape type 2
2026-03-27 11:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c, identifier: BL25220
2026-03-27 11:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c with identifier: BL25220
2026-03-27 11:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c with identifier: BL25220
2026-03-27 11:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23ae9f29-b6d5-5ac0-8b35-4e0470837e1c with identifier: BL25220 to the API
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:51:02Z',
 'fuel_type': 'hybrid',
 'id': '23ae9f29-b6d5-5ac0-8b35-4e0470837e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL25220',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 186253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-04',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL25220%27 HTTP/1.1" 200 None
2026-03-27 11:37:25 [auto1.be] INFO: Saving data for BL25220: {'auction_closing_time': 1774630262.0, 'created_time': 1774341348.146921, 'last_price_update_time': 1774611445.450158}
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BL25220') HTTP/1.1" 204 0
2026-03-27 11:37:25 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-27 11:37:25 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-27 11:37:25 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-27 11:37:25 [auto1.be] INFO: Found listing with ID: WG96246
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG96246%27 HTTP/1.1" 200 None
2026-03-27 11:37:25 [auto1.be] INFO: Scrape type for WG96246: 2
2026-03-27 11:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 338f01d3-6189-5efc-a6be-dfed519ed871 with identifier: WG96246
2026-03-27 11:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 338f01d3-6189-5efc-a6be-dfed519ed871 with scrape type 2
2026-03-27 11:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 338f01d3-6189-5efc-a6be-dfed519ed871 with scrape type 2
2026-03-27 11:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 338f01d3-6189-5efc-a6be-dfed519ed871, identifier: WG96246
2026-03-27 11:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 338f01d3-6189-5efc-a6be-dfed519ed871 with identifier: WG96246
2026-03-27 11:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 338f01d3-6189-5efc-a6be-dfed519ed871 with identifier: WG96246
2026-03-27 11:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 338f01d3-6189-5efc-a6be-dfed519ed871 with identifier: WG96246 to the API
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-27T16:55:09Z',
 'fuel_type': 'petrol',
 'id': '338f01d3-6189-5efc-a6be-dfed519ed871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG96246',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan',
 'odometer': 65868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-14',
 'seller_name': None,
 'title': 'Dacia Logan 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2016}
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG96246%27 HTTP/1.1" 200 None
2026-03-27 11:37:26 [auto1.be] INFO: Saving data for WG96246: {'auction_closing_time': 1774630509.0, 'created_time': 1774298248.334888, 'last_price_update_time': 1774611446.063042}
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG96246') HTTP/1.1" 204 0
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK49914%27 HTTP/1.1" 200 None
2026-03-27 11:37:26 [auto1.be] INFO: Scrape type for YK49914: 0
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: PY47802
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-27 11:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:26 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: PM51414
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: CY95631
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-27 11:37:26 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-27 11:37:26 [auto1.be] INFO: Scrape type for DZ24480: 2
2026-03-27 11:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480
2026-03-27 11:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with scrape type 2
2026-03-27 11:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with scrape type 2
2026-03-27 11:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1, identifier: DZ24480
2026-03-27 11:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480
2026-03-27 11:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480
2026-03-27 11:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480 to the API
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-27T16:32:53Z',
 'fuel_type': 'petrol',
 'id': '0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ24480',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4 S-Cross',
 'odometer': 106268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-27',
 'seller_name': None,
 'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Saving data for DZ24480: {'auction_closing_time': 1774629173.0, 'created_time': 1773693556.320044, 'last_price_update_time': 1774611447.47183}
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ24480') HTTP/1.1" 204 0
2026-03-27 11:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: ZW60968
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: WE56868
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56868%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for WE56868: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS77634%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for GS77634: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: LW97961
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW97961%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for LW97961: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: FB96864
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN88473%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for AN88473: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: WM04109
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN27020%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for KN27020: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF46667%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for DF46667: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: FB06162
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB06162%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for FB06162: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: UE29178
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN83226%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for GN83226: 0
2026-03-27 11:37:27 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-27 11:37:27 [auto1.be] INFO: Scrape type for ZY04103: 2
2026-03-27 11:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-27 11:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2266def0-435c-58c5-85f6-2de59ae5b344 with scrape type 2
2026-03-27 11:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2266def0-435c-58c5-85f6-2de59ae5b344 with scrape type 2
2026-03-27 11:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2266def0-435c-58c5-85f6-2de59ae5b344, identifier: ZY04103
2026-03-27 11:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-27 11:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-27 11:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103 to the API
2026-03-27 11:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:32:01Z',
 'fuel_type': 'diesel',
 'id': '2266def0-435c-58c5-85f6-2de59ae5b344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY04103',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 341241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2008}
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Saving data for ZY04103: {'auction_closing_time': 1774629121.0, 'created_time': 1773301663.880859, 'last_price_update_time': 1774611448.160514}
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY04103') HTTP/1.1" 204 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TB39644%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for TB39644: 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: WA40549
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: VV24394
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV24394%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for VV24394: 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT01513%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for JT01513: 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: JA66364
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: US70780
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: KV15074
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV15074%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for KV15074: 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: AT63193
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT63193%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for AT63193: 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for WN85390: 2
2026-03-27 11:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390
2026-03-27 11:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ca133d-c56f-5344-9d0e-fa72d02b444f with scrape type 2
2026-03-27 11:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ca133d-c56f-5344-9d0e-fa72d02b444f with scrape type 2
2026-03-27 11:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a6ca133d-c56f-5344-9d0e-fa72d02b444f, identifier: WN85390
2026-03-27 11:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390
2026-03-27 11:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390
2026-03-27 11:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390 to the API
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:52:20Z',
 'fuel_type': 'diesel',
 'id': 'a6ca133d-c56f-5344-9d0e-fa72d02b444f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN85390',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 213326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-18',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Saving data for WN85390: {'auction_closing_time': 1774630340.0, 'created_time': 1773132015.791776, 'last_price_update_time': 1774611448.778814}
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN85390') HTTP/1.1" 204 0
2026-03-27 11:37:28 [auto1.be] INFO: Found listing with ID: BM42306
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BM42306%27 HTTP/1.1" 200 None
2026-03-27 11:37:28 [auto1.be] INFO: Scrape type for BM42306: 0
2026-03-27 11:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:29 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS18318%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for KS18318: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX75796%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for ZX75796: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: NP56862
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP56862%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for NP56862: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: LR06836
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF05397%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for JF05397: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK84429%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for RK84429: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ74735%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for CZ74735: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: KN58271
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN58271%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for KN58271: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: FN39801
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: EC31925
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC31925%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for EC31925: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: CH84926
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH84926%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for CH84926: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: GE93003
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: HD79839
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM85548%27 HTTP/1.1" 200 None
2026-03-27 11:37:29 [auto1.be] INFO: Scrape type for XM85548: 0
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: XF39050
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-27 11:37:29 [auto1.be] INFO: Found listing with ID: SF36206
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF36206%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for SF36206: 0
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: KA89236
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA89236%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for KA89236: 0
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: HV86645
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: NN61724
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: FW68725
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV70837%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for FV70837: 0
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: UC74238
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC74238%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for UC74238: 0
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: XN63687
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN63687%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for XN63687: 0
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for MU76581: 2
2026-03-27 11:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581
2026-03-27 11:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with scrape type 2
2026-03-27 11:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with scrape type 2
2026-03-27 11:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70, identifier: MU76581
2026-03-27 11:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581
2026-03-27 11:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581
2026-03-27 11:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b76b8ee-2495-54f1-8e45-a9c301cc4e70 with identifier: MU76581 to the API
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:16:53Z',
 'fuel_type': 'petrol',
 'id': '6b76b8ee-2495-54f1-8e45-a9c301cc4e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU76581',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 77329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-04',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU76581%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Saving data for MU76581: {'auction_closing_time': 1774628213.0, 'created_time': 1774427754.837633, 'last_price_update_time': 1774611450.558461}
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU76581') HTTP/1.1" 204 0
2026-03-27 11:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-27 11:37:30 [auto1.be] INFO: Found listing with ID: XE83384
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE83384%27 HTTP/1.1" 200 None
2026-03-27 11:37:30 [auto1.be] INFO: Scrape type for XE83384: 2
2026-03-27 11:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3211f576-d083-58cd-b949-11d5a37797d9 with identifier: XE83384
2026-03-27 11:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3211f576-d083-58cd-b949-11d5a37797d9 with scrape type 2
2026-03-27 11:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3211f576-d083-58cd-b949-11d5a37797d9 with scrape type 2
2026-03-27 11:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3211f576-d083-58cd-b949-11d5a37797d9, identifier: XE83384
2026-03-27 11:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3211f576-d083-58cd-b949-11d5a37797d9 with identifier: XE83384
2026-03-27 11:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3211f576-d083-58cd-b949-11d5a37797d9 with identifier: XE83384
2026-03-27 11:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3211f576-d083-58cd-b949-11d5a37797d9 with identifier: XE83384 to the API
2026-03-27 11:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:21:13Z',
 'fuel_type': 'diesel',
 'id': '3211f576-d083-58cd-b949-11d5a37797d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE83384',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 353362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE83384%27 HTTP/1.1" 200 None
2026-03-27 11:37:31 [auto1.be] INFO: Saving data for XE83384: {'auction_closing_time': 1774628473.0, 'created_time': 1773225618.562723, 'last_price_update_time': 1774611451.42349}
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE83384') HTTP/1.1" 204 0
2026-03-27 11:37:31 [auto1.be] INFO: Found listing with ID: TK21885
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK21885%27 HTTP/1.1" 200 None
2026-03-27 11:37:31 [auto1.be] INFO: Scrape type for TK21885: 2
2026-03-27 11:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9404bc-01f3-59db-8c9e-3ee7591a0a1e with identifier: TK21885
2026-03-27 11:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9404bc-01f3-59db-8c9e-3ee7591a0a1e with scrape type 2
2026-03-27 11:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9404bc-01f3-59db-8c9e-3ee7591a0a1e with scrape type 2
2026-03-27 11:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec9404bc-01f3-59db-8c9e-3ee7591a0a1e, identifier: TK21885
2026-03-27 11:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec9404bc-01f3-59db-8c9e-3ee7591a0a1e with identifier: TK21885
2026-03-27 11:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec9404bc-01f3-59db-8c9e-3ee7591a0a1e with identifier: TK21885
2026-03-27 11:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec9404bc-01f3-59db-8c9e-3ee7591a0a1e with identifier: TK21885 to the API
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:45:05Z',
 'fuel_type': 'diesel',
 'id': 'ec9404bc-01f3-59db-8c9e-3ee7591a0a1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK21885',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 112708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-18',
 'seller_name': None,
 'title': 'BMW 1er 120d Edition Sport Line Shadow',
 'transmission': 'automatic',
 'trim': 'Edition Sport Line Shadow',
 'year': 2019}
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK21885%27 HTTP/1.1" 200 None
2026-03-27 11:37:31 [auto1.be] INFO: Saving data for TK21885: {'auction_closing_time': 1774629905.0, 'created_time': 1773240206.356139, 'last_price_update_time': 1774611451.837543}
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK21885') HTTP/1.1" 204 0
2026-03-27 11:37:31 [auto1.be] INFO: Found listing with ID: XM70958
2026-03-27 11:37:31 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK47918%27 HTTP/1.1" 200 None
2026-03-27 11:37:31 [auto1.be] INFO: Scrape type for LK47918: 2
2026-03-27 11:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9947107e-c6bd-5b50-ae8d-6ce5257edea6 with identifier: LK47918
2026-03-27 11:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9947107e-c6bd-5b50-ae8d-6ce5257edea6 with scrape type 2
2026-03-27 11:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9947107e-c6bd-5b50-ae8d-6ce5257edea6 with scrape type 2
2026-03-27 11:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9947107e-c6bd-5b50-ae8d-6ce5257edea6, identifier: LK47918
2026-03-27 11:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9947107e-c6bd-5b50-ae8d-6ce5257edea6 with identifier: LK47918
2026-03-27 11:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9947107e-c6bd-5b50-ae8d-6ce5257edea6 with identifier: LK47918
2026-03-27 11:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9947107e-c6bd-5b50-ae8d-6ce5257edea6 with identifier: LK47918 to the API
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-27T16:53:29Z',
 'fuel_type': 'petrol',
 'id': '9947107e-c6bd-5b50-ae8d-6ce5257edea6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK47918',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 211991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-27',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK47918%27 HTTP/1.1" 200 None
2026-03-27 11:37:32 [auto1.be] INFO: Saving data for LK47918: {'auction_closing_time': 1774630409.0, 'created_time': 1773137959.395571, 'last_price_update_time': 1774611452.294334}
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK47918') HTTP/1.1" 204 0
2026-03-27 11:37:32 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08447%27 HTTP/1.1" 200 None
2026-03-27 11:37:32 [auto1.be] INFO: Scrape type for GU08447: 0
2026-03-27 11:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:33 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: MH45293
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH45293%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for MH45293: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: CY67407
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN67239%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for YN67239: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: AG26993
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: YC80318
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: MD91238
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD91238%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for MD91238: 2
2026-03-27 11:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238
2026-03-27 11:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da75691a-ea08-5b75-a3cd-5201273acd6a with scrape type 2
2026-03-27 11:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da75691a-ea08-5b75-a3cd-5201273acd6a with scrape type 2
2026-03-27 11:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da75691a-ea08-5b75-a3cd-5201273acd6a, identifier: MD91238
2026-03-27 11:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238
2026-03-27 11:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238
2026-03-27 11:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238 to the API
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-27T16:47:29Z',
 'fuel_type': 'diesel',
 'id': 'da75691a-ea08-5b75-a3cd-5201273acd6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD91238',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 234620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-01',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Eco',
 'transmission': 'manual',
 'trim': 'Eco',
 'year': 2009}
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD91238%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Saving data for MD91238: {'auction_closing_time': 1774630049.0, 'created_time': 1774341354.006394, 'last_price_update_time': 1774611453.768646}
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD91238') HTTP/1.1" 204 0
2026-03-27 11:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: VA39343
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA39343%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for VA39343: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: TE17554
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE17554%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for TE17554: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ90167%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for YZ90167: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: FE77840
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: PE40780
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: DS76923
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: JT80061
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT80061%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for JT80061: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: VR98111
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR98111%27 HTTP/1.1" 200 None
2026-03-27 11:37:33 [auto1.be] INFO: Scrape type for VR98111: 0
2026-03-27 11:37:33 [auto1.be] INFO: Found listing with ID: MW35428
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW35428%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for MW35428: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: RK68495
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX63908%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for WX63908: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW00167%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for CW00167: 2
2026-03-27 11:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c37b1f-cdec-5939-b612-713d28029140 with identifier: CW00167
2026-03-27 11:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c37b1f-cdec-5939-b612-713d28029140 with scrape type 2
2026-03-27 11:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c37b1f-cdec-5939-b612-713d28029140 with scrape type 2
2026-03-27 11:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3c37b1f-cdec-5939-b612-713d28029140, identifier: CW00167
2026-03-27 11:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3c37b1f-cdec-5939-b612-713d28029140 with identifier: CW00167
2026-03-27 11:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3c37b1f-cdec-5939-b612-713d28029140 with identifier: CW00167
2026-03-27 11:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3c37b1f-cdec-5939-b612-713d28029140 with identifier: CW00167 to the API
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:41:27Z',
 'fuel_type': 'petrol',
 'id': 'd3c37b1f-cdec-5939-b612-713d28029140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW00167',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 109712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW00167%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Saving data for CW00167: {'auction_closing_time': 1774629687.0, 'created_time': 1773240282.413671, 'last_price_update_time': 1774611454.662494}
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW00167') HTTP/1.1" 204 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for NN42676: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: UV85914
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV85914%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for UV85914: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: ML50952
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: WM48145
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: SH20992
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP87063%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for TP87063: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER13199%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for ER13199: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE01545%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for SE01545: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR37992%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for PR37992: 0
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-27 11:37:34 [auto1.be] INFO: Found listing with ID: XG09867
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG09867%27 HTTP/1.1" 200 None
2026-03-27 11:37:34 [auto1.be] INFO: Scrape type for XG09867: 0
2026-03-27 11:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:35 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: ZX19324
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: WZ29783
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ29783%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for WZ29783: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: XW87323
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC53588%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for ZC53588: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: LV62557
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LV62557%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for LV62557: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: JU90713
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: AS88658
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: RA18682
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: HA43038
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: JD50267
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: GB24395
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB24395%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for GB24395: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: KD18952
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD18952%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for KD18952: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: GB16133
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: RY00106
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY00106%27 HTTP/1.1" 200 None
2026-03-27 11:37:35 [auto1.be] INFO: Scrape type for RY00106: 0
2026-03-27 11:37:35 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-27 11:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT18330%27 HTTP/1.1" 200 None
2026-03-27 11:37:36 [auto1.be] INFO: Scrape type for BT18330: 0
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-27 11:37:36 [auto1.be] INFO: Scrape type for PL33803: 2
2026-03-27 11:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803
2026-03-27 11:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e691580-8a7c-5497-8113-4ce00c1cc7cf with scrape type 2
2026-03-27 11:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e691580-8a7c-5497-8113-4ce00c1cc7cf with scrape type 2
2026-03-27 11:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e691580-8a7c-5497-8113-4ce00c1cc7cf, identifier: PL33803
2026-03-27 11:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803
2026-03-27 11:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803
2026-03-27 11:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803 to the API
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:57:16Z',
 'fuel_type': 'petrol',
 'id': '3e691580-8a7c-5497-8113-4ce00c1cc7cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL33803',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 64332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2019}
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-27 11:37:36 [auto1.be] INFO: Saving data for PL33803: {'auction_closing_time': 1774630636.0, 'created_time': 1773131894.008373, 'last_price_update_time': 1774611456.857636}
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL33803') HTTP/1.1" 204 0
2026-03-27 11:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: DR49981
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS83423%27 HTTP/1.1" 200 None
2026-03-27 11:37:36 [auto1.be] INFO: Scrape type for MS83423: 0
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: GL39756
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: PC30370
2026-03-27 11:37:36 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-27 11:37:36 [auto1.be] INFO: Scrape type for KW49487: 2
2026-03-27 11:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487
2026-03-27 11:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd05363b-356e-5cd3-826c-4d278edb5e0c with scrape type 2
2026-03-27 11:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd05363b-356e-5cd3-826c-4d278edb5e0c with scrape type 2
2026-03-27 11:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd05363b-356e-5cd3-826c-4d278edb5e0c, identifier: KW49487
2026-03-27 11:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487
2026-03-27 11:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487
2026-03-27 11:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd05363b-356e-5cd3-826c-4d278edb5e0c with identifier: KW49487 to the API
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:01:25Z',
 'fuel_type': 'diesel',
 'id': 'dd05363b-356e-5cd3-826c-4d278edb5e0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW49487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 136810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2018}
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW49487%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Saving data for KW49487: {'auction_closing_time': 1774627285.0, 'created_time': 1773230571.822832, 'last_price_update_time': 1774611457.436572}
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW49487') HTTP/1.1" 204 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: WZ44020
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44020%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for WZ44020: 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: ZG35997
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE05105%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for GE05105: 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW03008%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for PW03008: 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: BZ33421
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ33421%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for BZ33421: 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: LK78865
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: XZ87385
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ87385%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for XZ87385: 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: LD15814
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: JZ19867
2026-03-27 11:37:37 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-27 11:37:37 [auto1.be] INFO: Scrape type for GN71373: 0
2026-03-27 11:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:38 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: XM26582
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH59922%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for TH59922: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: CE58655
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: BE29252
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: XP37575
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: TT74487
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: HX14225
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX14225%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for HX14225: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN50786%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for YN50786: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: SF85634
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-27 11:37:38 [auto1.be] INFO: Found listing with ID: KJ95160
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KJ95160%27 HTTP/1.1" 200 None
2026-03-27 11:37:38 [auto1.be] INFO: Scrape type for KJ95160: 0
2026-03-27 11:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:39 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-27 11:37:39 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-27 11:37:39 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-27 11:37:39 [auto1.be] INFO: Scrape type for DZ54195: 0
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV74957%27 HTTP/1.1" 200 None
2026-03-27 11:37:39 [auto1.be] INFO: Scrape type for KV74957: 0
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-27 11:37:39 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: KS24234
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS24234%27 HTTP/1.1" 200 None
2026-03-27 11:37:39 [auto1.be] INFO: Scrape type for KS24234: 0
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: ZD19958
2026-03-27 11:37:39 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-27 11:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: MA90783
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA90783%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for MA90783: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: MJ36288
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for DH89229: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: GT47887
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: TL66022
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL66022%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for TL66022: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: HW94907
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: DD03061
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD03061%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for DD03061: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: LC64716
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC32489%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for GC32489: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: SP46117
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP46117%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for SP46117: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: EA75507
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA75507%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for EA75507: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: GZ93190
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: KS77192
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS77192%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for KS77192: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: UU18896
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU18896%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for UU18896: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: RG72901
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG72901%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for RG72901: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: TE96741
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE96741%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for TE96741: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: CU79953
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU79953%27 HTTP/1.1" 200 None
2026-03-27 11:37:40 [auto1.be] INFO: Scrape type for CU79953: 0
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: VS83559
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: XF87645
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: ER31989
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: SP15752
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: VV37865
2026-03-27 11:37:40 [auto1.be] INFO: Found listing with ID: FW03307
2026-03-27 11:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:41 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: WB15447
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: PJ20069
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for ZP04877: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ML39304
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML39304%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for ML39304: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: TY45516
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY45516%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for TY45516: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: XK92012
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK92012%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for XK92012: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ZB34516
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB34516%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for ZB34516: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: TN24530
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ND54959
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: GW04237
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW04237%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for GW04237: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: VH69211
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ZC59794
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: XV99186
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV99186%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for XV99186: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: VC49251
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: BZ25768
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ25768%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for BZ25768: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: XF87420
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF87420%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for XF87420: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: DC73649
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC73649%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for DC73649: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: PY65858
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY65858%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for PY65858: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: VN64438
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VN64438%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for VN64438: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: NB36446
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB36446%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for NB36446: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ZJ12375
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: SW89797
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW89797%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for SW89797: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: TG29223
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB46987%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for YB46987: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: LW64477
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW64477%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for LW64477: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: PM49627
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ZA19942
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA19942%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for ZA19942: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: RY00643
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY00643%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for RY00643: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: FF61873
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF61873%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for FF61873: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: GW03749
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: MR93085
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR93085%27 HTTP/1.1" 200 None
2026-03-27 11:37:41 [auto1.be] INFO: Scrape type for MR93085: 0
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: ZK09193
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: JD44636
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: TY52834
2026-03-27 11:37:41 [auto1.be] INFO: Found listing with ID: CV18162
2026-03-27 11:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:45 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: CF50288
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF50288%27 HTTP/1.1" 200 None
2026-03-27 11:37:45 [auto1.be] INFO: Scrape type for CF50288: 0
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-27 11:37:45 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: YY56036
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY56036%27 HTTP/1.1" 200 None
2026-03-27 11:37:45 [auto1.be] INFO: Scrape type for YY56036: 0
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: EA30540
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-27 11:37:45 [auto1.be] INFO: Scrape type for EP64027: 0
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: SK61046
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: ES58711
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: NT61601
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: LZ66388
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: WK59529
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: AG29104
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: PE56761
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: MN46567
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN46567%27 HTTP/1.1" 200 None
2026-03-27 11:37:45 [auto1.be] INFO: Scrape type for MN46567: 0
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: GJ68786
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ68786%27 HTTP/1.1" 200 None
2026-03-27 11:37:45 [auto1.be] INFO: Scrape type for GJ68786: 0
2026-03-27 11:37:45 [auto1.be] INFO: Found listing with ID: JB31829
2026-03-27 11:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB31829%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for JB31829: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: NP88880
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: RP97415
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP97415%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for RP97415: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: CL37184
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL37184%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for CL37184: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: SF61726
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: TT28732
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: WB92078
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for VL25326: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: CX65783
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: WT70323
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: FU55171
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU55171%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for FU55171: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: XH46511
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: CK00600
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: ET54219
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: CE79076
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE79076%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for CE79076: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: SG10691
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG10691%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for SG10691: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: JK22182
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: VM59401
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: NX41996
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: BT95259
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT95259%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for BT95259: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: XE29457
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for HX23250: 0
2026-03-27 11:37:46 [auto1.be] INFO: Found listing with ID: TL08922
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL08922%27 HTTP/1.1" 200 None
2026-03-27 11:37:46 [auto1.be] INFO: Scrape type for TL08922: 0
2026-03-27 11:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:47 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: MN47281
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: UE04390
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE04390%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for UE04390: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: AG93590
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG93590%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for AG93590: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: WU19263
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU19263%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for WU19263: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: ST88795
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST88795%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for ST88795: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for PZ32696: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: SD82427
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: YL89644
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL89644%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for YL89644: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: PU20100
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU20100%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for PU20100: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: CR05374
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR05374%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for CR05374: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: LP05906
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP05906%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for LP05906: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: VN89668
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: KM82747
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM82747%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for KM82747: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for SD10160: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: HK73230
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK73230%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for HK73230: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: DK99913
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: GY07088
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GY07088%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for GY07088: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: AJ21944
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: WV34567
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV34567%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for WV34567: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: HF24600
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF24600%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for HF24600: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: CP32047
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP32047%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for CP32047: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: UJ17868
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: BE26093
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: GG31991
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG31991%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for GG31991: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: RC95158
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: SP85086
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP85086%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for SP85086: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: YS72178
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU36315%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for PU36315: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: VF20080
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF20080%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for VF20080: 0
2026-03-27 11:37:47 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-27 11:37:47 [auto1.be] INFO: Scrape type for TS78695: 0
2026-03-27 11:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:48 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR35998%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for JR35998: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for BN53670: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ82774%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for BZ82774: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM74317%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for FM74317: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS12412%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for JS12412: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-27 11:37:48 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-27 11:37:48 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: AK05672
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK05672%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for AK05672: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: XJ74253
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: EM04401
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: FB17087
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: SR94284
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR94284%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for SR94284: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: LN26575
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN26575%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for LN26575: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: CY75465
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: MV45943
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: DD53795
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD53795%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for DD53795: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: FX35985
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FX35985%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for FX35985: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: RL87694
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: YU37075
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: FA46928
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA46928%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for FA46928: 0
2026-03-27 11:37:49 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-27 11:37:49 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-27 11:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:50 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: NT98623
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: CV21559
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW46644%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for RW46644: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: ZC61300
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: XL78848
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: BR78441
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: FK60732
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: GH92132
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH92132%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for GH92132: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: XF72387
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: RD73499
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: CL98862
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: ZP58534
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP58534%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for ZP58534: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: FU67650
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: EY23386
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY23386%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for EY23386: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: EX87629
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX87629%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for EX87629: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: NC65783
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC65783%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for NC65783: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: EL96244
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: DF73363
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR10172%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for WR10172: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: VN82922
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VN82922%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for VN82922: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: PX01285
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PX01285%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for PX01285: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: BU09612
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: YX87220
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: TD43625
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD43625%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for TD43625: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: BN85648
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM97787%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for XM97787: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: WR97935
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR97935%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for WR97935: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: EM55936
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: TT36853
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT36853%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for TT36853: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: NA32288
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: XH06937
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for XY08671: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: LW44669
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-27 11:37:50 [auto1.be] INFO: Found listing with ID: ZE06900
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZE06900%27 HTTP/1.1" 200 None
2026-03-27 11:37:50 [auto1.be] INFO: Scrape type for ZE06900: 0
2026-03-27 11:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:51 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: LA82396
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: JY55769
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55769%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for JY55769: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM94904%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for RM94904: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: ZB61293
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: RP38047
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP38047%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for RP38047: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: DF67918
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF67918%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for DF67918: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF17884%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for EF17884: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH30418%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for KH30418: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: SR19340
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR19340%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for SR19340: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: UU59340
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU59340%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for UU59340: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: ZJ25058
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX92013%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for CX92013: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: GS88032
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: RE64899
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE64899%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for RE64899: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM09652%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for CM09652: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB89489%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for AB89489: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-27 11:37:51 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-27 11:37:51 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-27 11:37:52 [auto1.be] INFO: Found listing with ID: KK86800
2026-03-27 11:37:52 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-27 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-27 11:37:52 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-27 11:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:53 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: KV92219
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV92219%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for KV92219: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: YS24197
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for BT94428: 2
2026-03-27 11:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-27 11:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with scrape type 2
2026-03-27 11:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with scrape type 2
2026-03-27 11:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60, identifier: BT94428
2026-03-27 11:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-27 11:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428
2026-03-27 11:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60 with identifier: BT94428 to the API
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-27T16:40:58Z',
 'fuel_type': 'hybrid',
 'id': 'a4e4dbe1-3b0d-5fb2-90cb-dbeb875cbd60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT94428',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 164578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-16',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription Expression 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2020}
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Saving data for BT94428: {'auction_closing_time': 1774629658.0, 'created_time': 1774524935.464035, 'last_price_update_time': 1774611473.762761}
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT94428') HTTP/1.1" 204 0
2026-03-27 11:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH69152%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for TH69152: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: CU75749
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: RD19082
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD19082%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for RD19082: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: RZ51368
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ51368%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for RZ51368: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: VG31015
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VG31015%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for VG31015: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: EG27418
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: SL48266
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL48266%27 HTTP/1.1" 200 None
2026-03-27 11:37:53 [auto1.be] INFO: Scrape type for SL48266: 0
2026-03-27 11:37:53 [auto1.be] INFO: Found listing with ID: FW44566
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW44566%27 HTTP/1.1" 200 None
2026-03-27 11:37:54 [auto1.be] INFO: Scrape type for FW44566: 0
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: YB31848
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB31848%27 HTTP/1.1" 200 None
2026-03-27 11:37:54 [auto1.be] INFO: Scrape type for YB31848: 0
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-27 11:37:54 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-27 11:37:54 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-27 11:37:54 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-27 11:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:54 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-27 11:37:54 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-27 11:37:54 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-27 11:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG55963%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for WG55963: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB55358%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for RB55358: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ27727%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for HJ27727: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: NS72953
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS72953%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for NS72953: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: MS92273
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: KM41856
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for XT14784: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: AG09898
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for AY48728: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF35218%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for AF35218: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: UD97429
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX27110%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for AX27110: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR44079%27 HTTP/1.1" 200 None
2026-03-27 11:37:55 [auto1.be] INFO: Scrape type for BR44079: 0
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-27 11:37:55 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-27 11:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:37:56 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1873 | hits on page: 40
2026-03-27 11:37:56 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-27 11:37:56 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-27 11:37:56 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-27 11:37:56 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-27 11:37:56 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-27 11:37:56 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-27 11:37:56 [auto1.be] INFO: Found listing with ID: EM35888
2026-03-27 11:37:56 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS64524%27 HTTP/1.1" 200 None
2026-03-27 11:37:56 [auto1.be] INFO: Scrape type for WS64524: 2
2026-03-27 11:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5677b8a1-e9d7-58df-961e-ed6bc50b3b39 with identifier: WS64524
2026-03-27 11:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5677b8a1-e9d7-58df-961e-ed6bc50b3b39 with scrape type 2
2026-03-27 11:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5677b8a1-e9d7-58df-961e-ed6bc50b3b39 with scrape type 2
2026-03-27 11:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5677b8a1-e9d7-58df-961e-ed6bc50b3b39, identifier: WS64524
2026-03-27 11:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5677b8a1-e9d7-58df-961e-ed6bc50b3b39 with identifier: WS64524
2026-03-27 11:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5677b8a1-e9d7-58df-961e-ed6bc50b3b39 with identifier: WS64524
2026-03-27 11:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5677b8a1-e9d7-58df-961e-ed6bc50b3b39 with identifier: WS64524 to the API
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:59:01Z',
 'fuel_type': 'diesel',
 'id': '5677b8a1-e9d7-58df-961e-ed6bc50b3b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS64524',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'L 200',
 'odometer': 186733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': None,
 'title': 'Mitsubishi L 200 2.4 DI-D Top Doppelkabine 4WD',
 'transmission': 'automatic',
 'trim': 'Top Doppelkabine 4WD',
 'year': 2018}
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS64524%27 HTTP/1.1" 200 None
2026-03-27 11:37:56 [auto1.be] INFO: Saving data for WS64524: {'auction_closing_time': 1774630741.0, 'created_time': 1774524921.290936, 'last_price_update_time': 1774611476.863877}
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WS64524') HTTP/1.1" 204 0
2026-03-27 11:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:37:57 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-27 11:37:57 [auto1.be] INFO: Scrape type for UM95648: 2
2026-03-27 11:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-27 11:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eee887d9-6deb-5308-8e85-31dd9eb664cc with scrape type 2
2026-03-27 11:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eee887d9-6deb-5308-8e85-31dd9eb664cc with scrape type 2
2026-03-27 11:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eee887d9-6deb-5308-8e85-31dd9eb664cc, identifier: UM95648
2026-03-27 11:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-27 11:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648
2026-03-27 11:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eee887d9-6deb-5308-8e85-31dd9eb664cc with identifier: UM95648 to the API
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:32:25Z',
 'fuel_type': 'diesel',
 'id': 'eee887d9-6deb-5308-8e85-31dd9eb664cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM95648',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 165535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-02',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-27 11:37:57 [auto1.be] INFO: Saving data for UM95648: {'auction_closing_time': 1774629145.0, 'created_time': 1774524922.388539, 'last_price_update_time': 1774611477.44854}
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM95648') HTTP/1.1" 204 0
2026-03-27 11:37:57 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-27 11:37:57 [auto1.be] INFO: Scrape type for VK66376: 2
2026-03-27 11:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-27 11:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059b1df0-5814-574a-965a-c5fe9f46e39a with scrape type 2
2026-03-27 11:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059b1df0-5814-574a-965a-c5fe9f46e39a with scrape type 2
2026-03-27 11:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 059b1df0-5814-574a-965a-c5fe9f46e39a, identifier: VK66376
2026-03-27 11:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-27 11:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376
2026-03-27 11:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 059b1df0-5814-574a-965a-c5fe9f46e39a with identifier: VK66376 to the API
2026-03-27 11:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-27T16:32:07Z',
 'fuel_type': 'diesel',
 'id': '059b1df0-5814-574a-965a-c5fe9f46e39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK66376',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 303310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-27 11:37:58 [auto1.be] INFO: Saving data for VK66376: {'auction_closing_time': 1774629127.0, 'created_time': 1774524922.993098, 'last_price_update_time': 1774611478.584381}
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VK66376') HTTP/1.1" 204 0
2026-03-27 11:37:58 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-27 11:37:58 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-27 11:37:58 [auto1.be] INFO: Scrape type for ZG50395: 2
2026-03-27 11:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-27 11:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with scrape type 2
2026-03-27 11:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with scrape type 2
2026-03-27 11:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346, identifier: ZG50395
2026-03-27 11:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-27 11:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395
2026-03-27 11:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2771e6e6-d7a8-5505-9977-4d8b3d8a4346 with identifier: ZG50395 to the API
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:33:35Z',
 'fuel_type': 'diesel',
 'id': '2771e6e6-d7a8-5505-9977-4d8b3d8a4346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG50395',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 271982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-25',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-27 11:37:59 [auto1.be] INFO: Saving data for ZG50395: {'auction_closing_time': 1774629215.0, 'created_time': 1774524931.874126, 'last_price_update_time': 1774611479.031911}
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG50395') HTTP/1.1" 204 0
2026-03-27 11:37:59 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-27 11:37:59 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-27 11:37:59 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-27 11:37:59 [auto1.be] INFO: Scrape type for KU26204: 2
2026-03-27 11:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-27 11:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc75f6b6-f632-59f3-b824-437bc69208ee with scrape type 2
2026-03-27 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc75f6b6-f632-59f3-b824-437bc69208ee with scrape type 2
2026-03-27 11:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc75f6b6-f632-59f3-b824-437bc69208ee, identifier: KU26204
2026-03-27 11:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-27 11:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204
2026-03-27 11:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc75f6b6-f632-59f3-b824-437bc69208ee with identifier: KU26204 to the API
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:51:22Z',
 'fuel_type': 'petrol',
 'id': 'fc75f6b6-f632-59f3-b824-437bc69208ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU26204',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 55645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-11',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Life Pack M',
 'transmission': 'manual',
 'trim': 'Life Pack M',
 'year': 2021}
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-27 11:37:59 [auto1.be] INFO: Saving data for KU26204: {'auction_closing_time': 1774630282.0, 'created_time': 1774524952.752341, 'last_price_update_time': 1774611479.45511}
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU26204') HTTP/1.1" 204 0
2026-03-27 11:37:59 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-27 11:37:59 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM52966%27 HTTP/1.1" 200 None
2026-03-27 11:37:59 [auto1.be] INFO: Scrape type for SM52966: 2
2026-03-27 11:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c1a1146-3441-57d3-9896-9536b0f62ae3 with identifier: SM52966
2026-03-27 11:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c1a1146-3441-57d3-9896-9536b0f62ae3 with scrape type 2
2026-03-27 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c1a1146-3441-57d3-9896-9536b0f62ae3 with scrape type 2
2026-03-27 11:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c1a1146-3441-57d3-9896-9536b0f62ae3, identifier: SM52966
2026-03-27 11:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c1a1146-3441-57d3-9896-9536b0f62ae3 with identifier: SM52966
2026-03-27 11:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c1a1146-3441-57d3-9896-9536b0f62ae3 with identifier: SM52966
2026-03-27 11:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c1a1146-3441-57d3-9896-9536b0f62ae3 with identifier: SM52966 to the API
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-27T16:16:05Z',
 'fuel_type': 'petrol',
 'id': '1c1a1146-3441-57d3-9896-9536b0f62ae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM52966',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 23826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM52966%27 HTTP/1.1" 200 None
2026-03-27 11:37:59 [auto1.be] INFO: Saving data for SM52966: {'auction_closing_time': 1774628165.0, 'created_time': 1774524936.35916, 'last_price_update_time': 1774611479.828398}
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SM52966') HTTP/1.1" 204 0
2026-03-27 11:37:59 [auto1.be] INFO: Found listing with ID: JW02809
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW02809%27 HTTP/1.1" 200 None
2026-03-27 11:37:59 [auto1.be] INFO: Scrape type for JW02809: 2
2026-03-27 11:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26af128d-a5f3-5370-8e41-2f2f4f5d7326 with identifier: JW02809
2026-03-27 11:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26af128d-a5f3-5370-8e41-2f2f4f5d7326 with scrape type 2
2026-03-27 11:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26af128d-a5f3-5370-8e41-2f2f4f5d7326 with scrape type 2
2026-03-27 11:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26af128d-a5f3-5370-8e41-2f2f4f5d7326, identifier: JW02809
2026-03-27 11:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26af128d-a5f3-5370-8e41-2f2f4f5d7326 with identifier: JW02809
2026-03-27 11:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26af128d-a5f3-5370-8e41-2f2f4f5d7326 with identifier: JW02809
2026-03-27 11:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26af128d-a5f3-5370-8e41-2f2f4f5d7326 with identifier: JW02809 to the API
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-27T16:08:37Z',
 'fuel_type': 'diesel',
 'id': '26af128d-a5f3-5370-8e41-2f2f4f5d7326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW02809',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 109345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2012}
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW02809%27 HTTP/1.1" 200 None
2026-03-27 11:38:00 [auto1.be] INFO: Saving data for JW02809: {'auction_closing_time': 1774627717.0, 'created_time': 1774524954.41611, 'last_price_update_time': 1774611480.245436}
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW02809') HTTP/1.1" 204 0
2026-03-27 11:38:00 [auto1.be] INFO: Found listing with ID: CM13531
2026-03-27 11:38:00 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-27 11:38:00 [auto1.be] INFO: Found listing with ID: ZC13840
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC13840%27 HTTP/1.1" 200 None
2026-03-27 11:38:00 [auto1.be] INFO: Scrape type for ZC13840: 2
2026-03-27 11:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f321c2d1-aa57-5b9e-b0dd-217cc0d9f504 with identifier: ZC13840
2026-03-27 11:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f321c2d1-aa57-5b9e-b0dd-217cc0d9f504 with scrape type 2
2026-03-27 11:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f321c2d1-aa57-5b9e-b0dd-217cc0d9f504 with scrape type 2
2026-03-27 11:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f321c2d1-aa57-5b9e-b0dd-217cc0d9f504, identifier: ZC13840
2026-03-27 11:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f321c2d1-aa57-5b9e-b0dd-217cc0d9f504 with identifier: ZC13840
2026-03-27 11:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f321c2d1-aa57-5b9e-b0dd-217cc0d9f504 with identifier: ZC13840
2026-03-27 11:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f321c2d1-aa57-5b9e-b0dd-217cc0d9f504 with identifier: ZC13840 to the API
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:43:04Z',
 'fuel_type': 'petrol',
 'id': 'f321c2d1-aa57-5b9e-b0dd-217cc0d9f504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC13840',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 138153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2020}
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC13840%27 HTTP/1.1" 200 None
2026-03-27 11:38:00 [auto1.be] INFO: Saving data for ZC13840: {'auction_closing_time': 1774629784.0, 'created_time': 1774524930.528628, 'last_price_update_time': 1774611480.643469}
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC13840') HTTP/1.1" 204 0
2026-03-27 11:38:00 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-27 11:38:00 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-27 11:38:00 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-27 11:38:00 [auto1.be] INFO: Scrape type for CT30439: 2
2026-03-27 11:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-27 11:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42425bea-9115-5bff-9500-4f498b2837f6 with scrape type 2
2026-03-27 11:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42425bea-9115-5bff-9500-4f498b2837f6 with scrape type 2
2026-03-27 11:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42425bea-9115-5bff-9500-4f498b2837f6, identifier: CT30439
2026-03-27 11:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-27 11:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439
2026-03-27 11:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42425bea-9115-5bff-9500-4f498b2837f6 with identifier: CT30439 to the API
2026-03-27 11:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:11:14Z',
 'fuel_type': 'petrol',
 'id': '42425bea-9115-5bff-9500-4f498b2837f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT30439',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 118676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Saving data for CT30439: {'auction_closing_time': 1774627874.0, 'created_time': 1774524932.663709, 'last_price_update_time': 1774611481.122667}
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CT30439') HTTP/1.1" 204 0
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN30379%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Scrape type for WN30379: 0
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: XY01493
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: CJ31578
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN58260%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Scrape type for YN58260: 0
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Scrape type for TK93480: 2
2026-03-27 11:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-27 11:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with scrape type 2
2026-03-27 11:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with scrape type 2
2026-03-27 11:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba, identifier: TK93480
2026-03-27 11:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-27 11:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480
2026-03-27 11:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d6d8759-6b2c-54ac-a9a5-f2967f224dba with identifier: TK93480 to the API
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:13:58Z',
 'fuel_type': 'diesel',
 'id': '7d6d8759-6b2c-54ac-a9a5-f2967f224dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK93480',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 163254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-08',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Saving data for TK93480: {'auction_closing_time': 1774628038.0, 'created_time': 1774524925.555339, 'last_price_update_time': 1774611481.760592}
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK93480') HTTP/1.1" 204 0
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH06099%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Scrape type for JH06099: 0
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-27 11:38:01 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-27 11:38:01 [auto1.be] INFO: Scrape type for FC74189: 2
2026-03-27 11:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-27 11:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64420a0a-efcf-5a5e-9856-20d70760fb2c with scrape type 2
2026-03-27 11:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64420a0a-efcf-5a5e-9856-20d70760fb2c with scrape type 2
2026-03-27 11:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64420a0a-efcf-5a5e-9856-20d70760fb2c, identifier: FC74189
2026-03-27 11:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-27 11:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189
2026-03-27 11:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64420a0a-efcf-5a5e-9856-20d70760fb2c with identifier: FC74189 to the API
2026-03-27 11:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:49:33Z',
 'fuel_type': 'petrol',
 'id': '64420a0a-efcf-5a5e-9856-20d70760fb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC74189',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 27592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-27 11:38:02 [auto1.be] INFO: Saving data for FC74189: {'auction_closing_time': 1774630173.0, 'created_time': 1774524937.946134, 'last_price_update_time': 1774611482.154917}
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC74189') HTTP/1.1" 204 0
2026-03-27 11:38:02 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-27 11:38:02 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-27 11:38:02 [auto1.be] INFO: Scrape type for NJ59863: 2
2026-03-27 11:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-27 11:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with scrape type 2
2026-03-27 11:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with scrape type 2
2026-03-27 11:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e, identifier: NJ59863
2026-03-27 11:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-27 11:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863
2026-03-27 11:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3c38ce8-5ab1-56d2-80d8-4181e33ac78e with identifier: NJ59863 to the API
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:30:51Z',
 'fuel_type': 'petrol',
 'id': 'f3c38ce8-5ab1-56d2-80d8-4181e33ac78e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ59863',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 66923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'BMW 4er 420i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-27 11:38:02 [auto1.be] INFO: Saving data for NJ59863: {'auction_closing_time': 1774629051.0, 'created_time': 1774524927.251376, 'last_price_update_time': 1774611482.630174}
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ59863') HTTP/1.1" 204 0
2026-03-27 11:38:02 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-27 11:38:02 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-27 11:38:02 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE17510%27 HTTP/1.1" 200 None
2026-03-27 11:38:02 [auto1.be] INFO: Scrape type for KE17510: 0
2026-03-27 11:38:02 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-27 11:38:02 [auto1.be] INFO: Scrape type for YA14339: 2
2026-03-27 11:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-27 11:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eff9184-820c-50ba-a803-b4fc692dfb52 with scrape type 2
2026-03-27 11:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eff9184-820c-50ba-a803-b4fc692dfb52 with scrape type 2
2026-03-27 11:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4eff9184-820c-50ba-a803-b4fc692dfb52, identifier: YA14339
2026-03-27 11:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-27 11:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339
2026-03-27 11:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4eff9184-820c-50ba-a803-b4fc692dfb52 with identifier: YA14339 to the API
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:50:42Z',
 'fuel_type': 'diesel',
 'id': '4eff9184-820c-50ba-a803-b4fc692dfb52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA14339',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 225421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2015}
2026-03-27 11:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-27 11:38:03 [auto1.be] INFO: Saving data for YA14339: {'auction_closing_time': 1774630242.0, 'created_time': 1774524953.133571, 'last_price_update_time': 1774611483.025155}
2026-03-27 11:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA14339') HTTP/1.1" 204 0
2026-03-27 11:38:06 [scrapy.extensions.logstats] INFO: Crawled 114 pages (at 20 pages/min), scraped 189 items (at 52 items/min)
2026-03-27 11:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 11:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:38:30 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1873 | hits on page: 40
2026-03-27 11:38:30 [auto1.be] INFO: Found listing with ID: ZR60411
2026-03-27 11:38:30 [auto1.be] INFO: Found listing with ID: HT80651
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80651%27 HTTP/1.1" 200 None
2026-03-27 11:38:30 [auto1.be] INFO: Scrape type for HT80651: 2
2026-03-27 11:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b69c727-e703-5344-bb93-e3fc5961564a with identifier: HT80651
2026-03-27 11:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b69c727-e703-5344-bb93-e3fc5961564a with scrape type 2
2026-03-27 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b69c727-e703-5344-bb93-e3fc5961564a with scrape type 2
2026-03-27 11:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5b69c727-e703-5344-bb93-e3fc5961564a, identifier: HT80651
2026-03-27 11:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5b69c727-e703-5344-bb93-e3fc5961564a with identifier: HT80651
2026-03-27 11:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5b69c727-e703-5344-bb93-e3fc5961564a with identifier: HT80651
2026-03-27 11:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5b69c727-e703-5344-bb93-e3fc5961564a with identifier: HT80651 to the API
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-27T16:01:17Z',
 'fuel_type': 'petrol',
 'id': '5b69c727-e703-5344-bb93-e3fc5961564a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT80651',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 71321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80651%27 HTTP/1.1" 200 None
2026-03-27 11:38:30 [auto1.be] INFO: Saving data for HT80651: {'auction_closing_time': 1774627277.0, 'created_time': 1774384727.172744, 'last_price_update_time': 1774611510.778507}
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT80651') HTTP/1.1" 204 0
2026-03-27 11:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:38:30 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-27 11:38:30 [auto1.be] INFO: Scrape type for XE18058: 0
2026-03-27 11:38:30 [auto1.be] INFO: Found listing with ID: YH39959
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH39959%27 HTTP/1.1" 200 None
2026-03-27 11:38:30 [auto1.be] INFO: Scrape type for YH39959: 2
2026-03-27 11:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c153e68-4991-58c5-9c39-a69151ec7302 with identifier: YH39959
2026-03-27 11:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c153e68-4991-58c5-9c39-a69151ec7302 with scrape type 2
2026-03-27 11:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c153e68-4991-58c5-9c39-a69151ec7302 with scrape type 2
2026-03-27 11:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6c153e68-4991-58c5-9c39-a69151ec7302, identifier: YH39959
2026-03-27 11:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6c153e68-4991-58c5-9c39-a69151ec7302 with identifier: YH39959
2026-03-27 11:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6c153e68-4991-58c5-9c39-a69151ec7302 with identifier: YH39959
2026-03-27 11:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6c153e68-4991-58c5-9c39-a69151ec7302 with identifier: YH39959 to the API
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-27T16:21:20Z',
 'fuel_type': 'diesel',
 'id': '6c153e68-4991-58c5-9c39-a69151ec7302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH39959',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 152511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH39959%27 HTTP/1.1" 200 None
2026-03-27 11:38:31 [auto1.be] INFO: Saving data for YH39959: {'auction_closing_time': 1774628480.0, 'created_time': 1774384725.548298, 'last_price_update_time': 1774611511.542547}
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH39959') HTTP/1.1" 204 0
2026-03-27 11:38:31 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-27 11:38:31 [auto1.be] INFO: Found listing with ID: TT42662
2026-03-27 11:38:31 [auto1.be] INFO: Found listing with ID: LD98603
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD98603%27 HTTP/1.1" 200 None
2026-03-27 11:38:31 [auto1.be] INFO: Scrape type for LD98603: 2
2026-03-27 11:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89326aca-0d7f-5577-94e8-14478e0df319 with identifier: LD98603
2026-03-27 11:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89326aca-0d7f-5577-94e8-14478e0df319 with scrape type 2
2026-03-27 11:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89326aca-0d7f-5577-94e8-14478e0df319 with scrape type 2
2026-03-27 11:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 89326aca-0d7f-5577-94e8-14478e0df319, identifier: LD98603
2026-03-27 11:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 89326aca-0d7f-5577-94e8-14478e0df319 with identifier: LD98603
2026-03-27 11:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 89326aca-0d7f-5577-94e8-14478e0df319 with identifier: LD98603
2026-03-27 11:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 89326aca-0d7f-5577-94e8-14478e0df319 with identifier: LD98603 to the API
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:30:58Z',
 'fuel_type': 'petrol',
 'id': '89326aca-0d7f-5577-94e8-14478e0df319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD98603',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 122461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-10',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD98603%27 HTTP/1.1" 200 None
2026-03-27 11:38:31 [auto1.be] INFO: Saving data for LD98603: {'auction_closing_time': 1774629058.0, 'created_time': 1774524934.394204, 'last_price_update_time': 1774611511.921146}
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LD98603') HTTP/1.1" 204 0
2026-03-27 11:38:32 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-27 11:38:32 [auto1.be] INFO: Scrape type for YW29468: 2
2026-03-27 11:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-27 11:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91452478-9f75-5f80-adf9-e9c228fd122a with scrape type 2
2026-03-27 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91452478-9f75-5f80-adf9-e9c228fd122a with scrape type 2
2026-03-27 11:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 91452478-9f75-5f80-adf9-e9c228fd122a, identifier: YW29468
2026-03-27 11:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-27 11:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468
2026-03-27 11:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 91452478-9f75-5f80-adf9-e9c228fd122a with identifier: YW29468 to the API
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:34:25Z',
 'fuel_type': 'diesel',
 'id': '91452478-9f75-5f80-adf9-e9c228fd122a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW29468',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 187363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2018}
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-27 11:38:32 [auto1.be] INFO: Saving data for YW29468: {'auction_closing_time': 1774629265.0, 'created_time': 1774524953.567365, 'last_price_update_time': 1774611512.425737}
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW29468') HTTP/1.1" 204 0
2026-03-27 11:38:32 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-27 11:38:32 [auto1.be] INFO: Scrape type for ZA01438: 2
2026-03-27 11:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-27 11:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with scrape type 2
2026-03-27 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with scrape type 2
2026-03-27 11:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fddc3a48-b91e-5192-9f45-8fee8ffc63d2, identifier: ZA01438
2026-03-27 11:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-27 11:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438
2026-03-27 11:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fddc3a48-b91e-5192-9f45-8fee8ffc63d2 with identifier: ZA01438 to the API
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:17:41Z',
 'fuel_type': 'diesel',
 'id': 'fddc3a48-b91e-5192-9f45-8fee8ffc63d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA01438',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 198457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-11',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-27 11:38:32 [auto1.be] INFO: Saving data for ZA01438: {'auction_closing_time': 1774628261.0, 'created_time': 1774524981.495638, 'last_price_update_time': 1774611512.820322}
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZA01438') HTTP/1.1" 204 0
2026-03-27 11:38:32 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-27 11:38:32 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-27 11:38:32 [auto1.be] INFO: Scrape type for JW78855: 2
2026-03-27 11:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-27 11:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with scrape type 2
2026-03-27 11:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with scrape type 2
2026-03-27 11:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8, identifier: JW78855
2026-03-27 11:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-27 11:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855
2026-03-27 11:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5aab7a44-8f6d-5835-a2c6-84417fec9eb8 with identifier: JW78855 to the API
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-27T16:46:54Z',
 'fuel_type': 'petrol',
 'id': '5aab7a44-8f6d-5835-a2c6-84417fec9eb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW78855',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 155220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-27 11:38:33 [auto1.be] INFO: Saving data for JW78855: {'auction_closing_time': 1774630014.0, 'created_time': 1774524937.054344, 'last_price_update_time': 1774611513.194814}
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW78855') HTTP/1.1" 204 0
2026-03-27 11:38:33 [auto1.be] INFO: Found listing with ID: WL76087
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL76087%27 HTTP/1.1" 200 None
2026-03-27 11:38:33 [auto1.be] INFO: Scrape type for WL76087: 2
2026-03-27 11:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c652e8b-4867-5b82-8965-13c8aba693a8 with identifier: WL76087
2026-03-27 11:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c652e8b-4867-5b82-8965-13c8aba693a8 with scrape type 2
2026-03-27 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c652e8b-4867-5b82-8965-13c8aba693a8 with scrape type 2
2026-03-27 11:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c652e8b-4867-5b82-8965-13c8aba693a8, identifier: WL76087
2026-03-27 11:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c652e8b-4867-5b82-8965-13c8aba693a8 with identifier: WL76087
2026-03-27 11:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c652e8b-4867-5b82-8965-13c8aba693a8 with identifier: WL76087
2026-03-27 11:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c652e8b-4867-5b82-8965-13c8aba693a8 with identifier: WL76087 to the API
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:51:59Z',
 'fuel_type': 'petrol',
 'id': '5c652e8b-4867-5b82-8965-13c8aba693a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL76087',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 101787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-04-23',
 'seller_name': None,
 'title': 'Volvo S60 2.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL76087%27 HTTP/1.1" 200 None
2026-03-27 11:38:33 [auto1.be] INFO: Saving data for WL76087: {'auction_closing_time': 1774630319.0, 'created_time': 1774524994.521639, 'last_price_update_time': 1774611513.611454}
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL76087') HTTP/1.1" 204 0
2026-03-27 11:38:33 [auto1.be] INFO: Found listing with ID: RZ94244
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ94244%27 HTTP/1.1" 200 None
2026-03-27 11:38:33 [auto1.be] INFO: Scrape type for RZ94244: 2
2026-03-27 11:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f63104f-7f39-5bbd-bad4-f59f360da7d7 with identifier: RZ94244
2026-03-27 11:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f63104f-7f39-5bbd-bad4-f59f360da7d7 with scrape type 2
2026-03-27 11:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f63104f-7f39-5bbd-bad4-f59f360da7d7 with scrape type 2
2026-03-27 11:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f63104f-7f39-5bbd-bad4-f59f360da7d7, identifier: RZ94244
2026-03-27 11:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f63104f-7f39-5bbd-bad4-f59f360da7d7 with identifier: RZ94244
2026-03-27 11:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f63104f-7f39-5bbd-bad4-f59f360da7d7 with identifier: RZ94244
2026-03-27 11:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f63104f-7f39-5bbd-bad4-f59f360da7d7 with identifier: RZ94244 to the API
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:43:00Z',
 'fuel_type': 'petrol',
 'id': '9f63104f-7f39-5bbd-bad4-f59f360da7d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ94244',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 55810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2012}
2026-03-27 11:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ94244%27 HTTP/1.1" 200 None
2026-03-27 11:38:34 [auto1.be] INFO: Saving data for RZ94244: {'auction_closing_time': 1774629780.0, 'created_time': 1774524982.553203, 'last_price_update_time': 1774611514.004483}
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ94244') HTTP/1.1" 204 0
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-27 11:38:34 [auto1.be] INFO: Scrape type for LT97220: 2
2026-03-27 11:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-27 11:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with scrape type 2
2026-03-27 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with scrape type 2
2026-03-27 11:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f, identifier: LT97220
2026-03-27 11:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-27 11:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220
2026-03-27 11:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b2bece5-3783-5852-bbc2-c53cfc6aea3f with identifier: LT97220 to the API
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-27T16:07:26Z',
 'fuel_type': 'petrol',
 'id': '1b2bece5-3783-5852-bbc2-c53cfc6aea3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT97220',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 82658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-17',
 'seller_name': None,
 'title': 'Ford Fusion 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-27 11:38:34 [auto1.be] INFO: Saving data for LT97220: {'auction_closing_time': 1774627646.0, 'created_time': 1774524984.426966, 'last_price_update_time': 1774611514.401152}
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LT97220') HTTP/1.1" 204 0
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: GK19212
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-27 11:38:34 [auto1.be] INFO: Scrape type for NN42853: 2
2026-03-27 11:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-27 11:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with scrape type 2
2026-03-27 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with scrape type 2
2026-03-27 11:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3a8f7bf-03be-59d5-8042-8d30f99dccb1, identifier: NN42853
2026-03-27 11:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-27 11:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853
2026-03-27 11:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3a8f7bf-03be-59d5-8042-8d30f99dccb1 with identifier: NN42853 to the API
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-27T16:45:51Z',
 'fuel_type': 'petrol',
 'id': 'd3a8f7bf-03be-59d5-8042-8d30f99dccb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN42853',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 44541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Creative',
 'transmission': 'automatic',
 'trim': 'Creative',
 'year': 2022}
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-27 11:38:34 [auto1.be] INFO: Saving data for NN42853: {'auction_closing_time': 1774629951.0, 'created_time': 1774524941.213103, 'last_price_update_time': 1774611514.783094}
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN42853') HTTP/1.1" 204 0
2026-03-27 11:38:34 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-27 11:38:34 [auto1.be] INFO: Scrape type for RY85405: 2
2026-03-27 11:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-27 11:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f308b866-e519-553c-bdb7-b407ae95e0a3 with scrape type 2
2026-03-27 11:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f308b866-e519-553c-bdb7-b407ae95e0a3 with scrape type 2
2026-03-27 11:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f308b866-e519-553c-bdb7-b407ae95e0a3, identifier: RY85405
2026-03-27 11:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-27 11:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405
2026-03-27 11:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f308b866-e519-553c-bdb7-b407ae95e0a3 with identifier: RY85405 to the API
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:46:11Z',
 'fuel_type': 'diesel',
 'id': 'f308b866-e519-553c-bdb7-b407ae95e0a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY85405',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-27 11:38:35 [auto1.be] INFO: Saving data for RY85405: {'auction_closing_time': 1774629971.0, 'created_time': 1774524985.470521, 'last_price_update_time': 1774611515.27737}
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY85405') HTTP/1.1" 204 0
2026-03-27 11:38:35 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-27 11:38:35 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-27 11:38:35 [auto1.be] INFO: Scrape type for YN26679: 2
2026-03-27 11:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-27 11:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with scrape type 2
2026-03-27 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with scrape type 2
2026-03-27 11:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a, identifier: YN26679
2026-03-27 11:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-27 11:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679
2026-03-27 11:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1fc9325a-8b8b-5139-b0a7-0ccf1445e31a with identifier: YN26679 to the API
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-27T16:00:28Z',
 'fuel_type': 'petrol',
 'id': '1fc9325a-8b8b-5139-b0a7-0ccf1445e31a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN26679',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 133185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-06',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2005}
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-27 11:38:35 [auto1.be] INFO: Saving data for YN26679: {'auction_closing_time': 1774627228.0, 'created_time': 1774524948.559891, 'last_price_update_time': 1774611515.652604}
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN26679') HTTP/1.1" 204 0
2026-03-27 11:38:35 [auto1.be] INFO: Found listing with ID: HF19605
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF19605%27 HTTP/1.1" 200 None
2026-03-27 11:38:35 [auto1.be] INFO: Scrape type for HF19605: 2
2026-03-27 11:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4c8dda4-fa92-5fd2-ad29-85cc3df99c27 with identifier: HF19605
2026-03-27 11:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4c8dda4-fa92-5fd2-ad29-85cc3df99c27 with scrape type 2
2026-03-27 11:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4c8dda4-fa92-5fd2-ad29-85cc3df99c27 with scrape type 2
2026-03-27 11:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f4c8dda4-fa92-5fd2-ad29-85cc3df99c27, identifier: HF19605
2026-03-27 11:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f4c8dda4-fa92-5fd2-ad29-85cc3df99c27 with identifier: HF19605
2026-03-27 11:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f4c8dda4-fa92-5fd2-ad29-85cc3df99c27 with identifier: HF19605
2026-03-27 11:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f4c8dda4-fa92-5fd2-ad29-85cc3df99c27 with identifier: HF19605 to the API
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:34:41Z',
 'fuel_type': 'hybrid',
 'id': 'f4c8dda4-fa92-5fd2-ad29-85cc3df99c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF19605',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 88826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-09',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2020}
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF19605%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Saving data for HF19605: {'auction_closing_time': 1774629281.0, 'created_time': 1774524948.179773, 'last_price_update_time': 1774611516.068621}
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HF19605') HTTP/1.1" 204 0
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW21160%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Scrape type for MW21160: 0
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: YJ74551
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: EE72581
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE72581%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Scrape type for EE72581: 2
2026-03-27 11:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b38f94-987a-56d0-b456-12ea709864d3 with identifier: EE72581
2026-03-27 11:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b38f94-987a-56d0-b456-12ea709864d3 with scrape type 2
2026-03-27 11:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b38f94-987a-56d0-b456-12ea709864d3 with scrape type 2
2026-03-27 11:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98b38f94-987a-56d0-b456-12ea709864d3, identifier: EE72581
2026-03-27 11:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98b38f94-987a-56d0-b456-12ea709864d3 with identifier: EE72581
2026-03-27 11:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98b38f94-987a-56d0-b456-12ea709864d3 with identifier: EE72581
2026-03-27 11:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98b38f94-987a-56d0-b456-12ea709864d3 with identifier: EE72581 to the API
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-27T16:25:08Z',
 'fuel_type': 'diesel',
 'id': '98b38f94-987a-56d0-b456-12ea709864d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE72581',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 191999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-28',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2017}
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE72581%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Saving data for EE72581: {'auction_closing_time': 1774628708.0, 'created_time': 1774524951.192047, 'last_price_update_time': 1774611516.544898}
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EE72581') HTTP/1.1" 204 0
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: SR57196
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR57196%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Scrape type for SR57196: 2
2026-03-27 11:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c087f38-1d4f-58de-a82b-e938b625102d with identifier: SR57196
2026-03-27 11:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c087f38-1d4f-58de-a82b-e938b625102d with scrape type 2
2026-03-27 11:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c087f38-1d4f-58de-a82b-e938b625102d with scrape type 2
2026-03-27 11:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c087f38-1d4f-58de-a82b-e938b625102d, identifier: SR57196
2026-03-27 11:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c087f38-1d4f-58de-a82b-e938b625102d with identifier: SR57196
2026-03-27 11:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c087f38-1d4f-58de-a82b-e938b625102d with identifier: SR57196
2026-03-27 11:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c087f38-1d4f-58de-a82b-e938b625102d with identifier: SR57196 to the API
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:42:06Z',
 'fuel_type': 'diesel',
 'id': '3c087f38-1d4f-58de-a82b-e938b625102d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR57196',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-03',
 'seller_name': None,
 'title': 'Audi A6 2.5 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2003}
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR57196%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Saving data for SR57196: {'auction_closing_time': 1774629726.0, 'created_time': 1774524952.386673, 'last_price_update_time': 1774611516.95059}
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR57196') HTTP/1.1" 204 0
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-27 11:38:36 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-27 11:38:36 [auto1.be] INFO: Scrape type for RK12486: 2
2026-03-27 11:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-27 11:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with scrape type 2
2026-03-27 11:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with scrape type 2
2026-03-27 11:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a3bb856-96e4-574e-91fa-fa2220a9ea70, identifier: RK12486
2026-03-27 11:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-27 11:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486
2026-03-27 11:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a3bb856-96e4-574e-91fa-fa2220a9ea70 with identifier: RK12486 to the API
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:01:07Z',
 'fuel_type': 'diesel',
 'id': '5a3bb856-96e4-574e-91fa-fa2220a9ea70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12486',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 231164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2013}
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-27 11:38:37 [auto1.be] INFO: Saving data for RK12486: {'auction_closing_time': 1774627267.0, 'created_time': 1774524942.120289, 'last_price_update_time': 1774611517.386458}
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK12486') HTTP/1.1" 204 0
2026-03-27 11:38:37 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-27 11:38:37 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-27 11:38:37 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-27 11:38:37 [auto1.be] INFO: Scrape type for LM02594: 0
2026-03-27 11:38:37 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-27 11:38:37 [auto1.be] INFO: Scrape type for KS43499: 2
2026-03-27 11:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-27 11:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with scrape type 2
2026-03-27 11:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with scrape type 2
2026-03-27 11:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08, identifier: KS43499
2026-03-27 11:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-27 11:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499
2026-03-27 11:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c1a8fcfc-4ac9-5924-a6e7-6309db30fa08 with identifier: KS43499 to the API
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:21:21Z',
 'fuel_type': 'diesel',
 'id': 'c1a8fcfc-4ac9-5924-a6e7-6309db30fa08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS43499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-27 11:38:37 [auto1.be] INFO: Saving data for KS43499: {'auction_closing_time': 1774628481.0, 'created_time': 1774524950.490951, 'last_price_update_time': 1774611517.886852}
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KS43499') HTTP/1.1" 204 0
2026-03-27 11:38:37 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-27 11:38:37 [auto1.be] INFO: Scrape type for WC55286: 2
2026-03-27 11:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-27 11:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e465e6fd-fb29-5377-a170-172043a7b3bc with scrape type 2
2026-03-27 11:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e465e6fd-fb29-5377-a170-172043a7b3bc with scrape type 2
2026-03-27 11:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e465e6fd-fb29-5377-a170-172043a7b3bc, identifier: WC55286
2026-03-27 11:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-27 11:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286
2026-03-27 11:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e465e6fd-fb29-5377-a170-172043a7b3bc with identifier: WC55286 to the API
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:50:44Z',
 'fuel_type': 'diesel',
 'id': 'e465e6fd-fb29-5377-a170-172043a7b3bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC55286',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 215455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-22',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-27 11:38:38 [auto1.be] INFO: Saving data for WC55286: {'auction_closing_time': 1774630244.0, 'created_time': 1774524944.983296, 'last_price_update_time': 1774611518.299801}
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC55286') HTTP/1.1" 204 0
2026-03-27 11:38:38 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-27 11:38:38 [auto1.be] INFO: Scrape type for HK81119: 2
2026-03-27 11:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-27 11:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bbbfff-6905-504b-a81b-7851df51f18e with scrape type 2
2026-03-27 11:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64bbbfff-6905-504b-a81b-7851df51f18e with scrape type 2
2026-03-27 11:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64bbbfff-6905-504b-a81b-7851df51f18e, identifier: HK81119
2026-03-27 11:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-27 11:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119
2026-03-27 11:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64bbbfff-6905-504b-a81b-7851df51f18e with identifier: HK81119 to the API
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:36:00Z',
 'fuel_type': 'diesel',
 'id': '64bbbfff-6905-504b-a81b-7851df51f18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK81119',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 136811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Edition Standard',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Edition Standard',
 'year': 2017}
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-27 11:38:38 [auto1.be] INFO: Saving data for HK81119: {'auction_closing_time': 1774629360.0, 'created_time': 1774524949.236712, 'last_price_update_time': 1774611518.692633}
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK81119') HTTP/1.1" 204 0
2026-03-27 11:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:39:04 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1873 | hits on page: 40
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ37303%27 HTTP/1.1" 200 None
2026-03-27 11:39:04 [auto1.be] INFO: Scrape type for PJ37303: 0
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-27 11:39:04 [auto1.be] INFO: Scrape type for TG38013: 0
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN92139%27 HTTP/1.1" 200 None
2026-03-27 11:39:04 [auto1.be] INFO: Scrape type for YN92139: 0
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-27 11:39:04 [auto1.be] INFO: Found listing with ID: MU03862
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU03862%27 HTTP/1.1" 200 None
2026-03-27 11:39:04 [auto1.be] INFO: Scrape type for MU03862: 2
2026-03-27 11:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad649ffe-0f47-53c8-a391-4e543bd9f0ed with identifier: MU03862
2026-03-27 11:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad649ffe-0f47-53c8-a391-4e543bd9f0ed with scrape type 2
2026-03-27 11:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad649ffe-0f47-53c8-a391-4e543bd9f0ed with scrape type 2
2026-03-27 11:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad649ffe-0f47-53c8-a391-4e543bd9f0ed, identifier: MU03862
2026-03-27 11:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad649ffe-0f47-53c8-a391-4e543bd9f0ed with identifier: MU03862
2026-03-27 11:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad649ffe-0f47-53c8-a391-4e543bd9f0ed with identifier: MU03862
2026-03-27 11:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad649ffe-0f47-53c8-a391-4e543bd9f0ed with identifier: MU03862 to the API
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:08:02Z',
 'fuel_type': 'petrol',
 'id': 'ad649ffe-0f47-53c8-a391-4e543bd9f0ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU03862',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 123712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU03862%27 HTTP/1.1" 200 None
2026-03-27 11:39:05 [auto1.be] INFO: Saving data for MU03862: {'auction_closing_time': 1774627682.0, 'created_time': 1774524966.496274, 'last_price_update_time': 1774611545.165842}
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU03862') HTTP/1.1" 204 0
2026-03-27 11:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:39:05 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-27 11:39:05 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-27 11:39:05 [auto1.be] INFO: Found listing with ID: TD50799
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD50799%27 HTTP/1.1" 200 None
2026-03-27 11:39:05 [auto1.be] INFO: Scrape type for TD50799: 2
2026-03-27 11:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90634f52-c880-5f15-97e8-16793ff9c1c5 with identifier: TD50799
2026-03-27 11:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90634f52-c880-5f15-97e8-16793ff9c1c5 with scrape type 2
2026-03-27 11:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90634f52-c880-5f15-97e8-16793ff9c1c5 with scrape type 2
2026-03-27 11:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90634f52-c880-5f15-97e8-16793ff9c1c5, identifier: TD50799
2026-03-27 11:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90634f52-c880-5f15-97e8-16793ff9c1c5 with identifier: TD50799
2026-03-27 11:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90634f52-c880-5f15-97e8-16793ff9c1c5 with identifier: TD50799
2026-03-27 11:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90634f52-c880-5f15-97e8-16793ff9c1c5 with identifier: TD50799 to the API
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:03:09Z',
 'fuel_type': 'petrol',
 'id': '90634f52-c880-5f15-97e8-16793ff9c1c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD50799',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 79613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2011}
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD50799%27 HTTP/1.1" 200 None
2026-03-27 11:39:05 [auto1.be] INFO: Saving data for TD50799: {'auction_closing_time': 1774627389.0, 'created_time': 1774524993.49072, 'last_price_update_time': 1774611545.652345}
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD50799') HTTP/1.1" 204 0
2026-03-27 11:39:05 [auto1.be] INFO: Found listing with ID: ZB06103
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB06103%27 HTTP/1.1" 200 None
2026-03-27 11:39:05 [auto1.be] INFO: Scrape type for ZB06103: 2
2026-03-27 11:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70336810-e543-5ff0-9e0f-76d123a690a9 with identifier: ZB06103
2026-03-27 11:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70336810-e543-5ff0-9e0f-76d123a690a9 with scrape type 2
2026-03-27 11:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70336810-e543-5ff0-9e0f-76d123a690a9 with scrape type 2
2026-03-27 11:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70336810-e543-5ff0-9e0f-76d123a690a9, identifier: ZB06103
2026-03-27 11:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70336810-e543-5ff0-9e0f-76d123a690a9 with identifier: ZB06103
2026-03-27 11:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70336810-e543-5ff0-9e0f-76d123a690a9 with identifier: ZB06103
2026-03-27 11:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70336810-e543-5ff0-9e0f-76d123a690a9 with identifier: ZB06103 to the API
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:15:22Z',
 'fuel_type': 'petrol',
 'id': '70336810-e543-5ff0-9e0f-76d123a690a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB06103',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 160916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB06103%27 HTTP/1.1" 200 None
2026-03-27 11:39:06 [auto1.be] INFO: Saving data for ZB06103: {'auction_closing_time': 1774628122.0, 'created_time': 1774524962.593862, 'last_price_update_time': 1774611546.065385}
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZB06103') HTTP/1.1" 204 0
2026-03-27 11:39:06 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-27 11:39:06 [auto1.be] INFO: Scrape type for XE64009: 2
2026-03-27 11:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-27 11:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc4ff40-73f2-529a-842e-244a2a10a84f with scrape type 2
2026-03-27 11:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc4ff40-73f2-529a-842e-244a2a10a84f with scrape type 2
2026-03-27 11:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acc4ff40-73f2-529a-842e-244a2a10a84f, identifier: XE64009
2026-03-27 11:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-27 11:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009
2026-03-27 11:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acc4ff40-73f2-529a-842e-244a2a10a84f with identifier: XE64009 to the API
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-27T16:47:26Z',
 'fuel_type': 'diesel',
 'id': 'acc4ff40-73f2-529a-842e-244a2a10a84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE64009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 230277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-27 11:39:06 [auto1.be] INFO: Saving data for XE64009: {'auction_closing_time': 1774630046.0, 'created_time': 1774524970.16392, 'last_price_update_time': 1774611546.468489}
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE64009') HTTP/1.1" 204 0
2026-03-27 11:39:06 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-27 11:39:06 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-27 11:39:06 [auto1.be] INFO: Scrape type for PP48497: 2
2026-03-27 11:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-27 11:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with scrape type 2
2026-03-27 11:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with scrape type 2
2026-03-27 11:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41, identifier: PP48497
2026-03-27 11:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-27 11:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497
2026-03-27 11:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cc6588e-a48a-5e8a-88e2-2b1f91922c41 with identifier: PP48497 to the API
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:28:16Z',
 'fuel_type': 'petrol',
 'id': '8cc6588e-a48a-5e8a-88e2-2b1f91922c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP48497',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 109933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2016}
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-27 11:39:06 [auto1.be] INFO: Saving data for PP48497: {'auction_closing_time': 1774628896.0, 'created_time': 1774524963.747881, 'last_price_update_time': 1774611546.853947}
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PP48497') HTTP/1.1" 204 0
2026-03-27 11:39:06 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-27 11:39:06 [auto1.be] INFO: Scrape type for FK29667: 2
2026-03-27 11:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-27 11:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6fa5728-227f-5472-97d4-e131b884a993 with scrape type 2
2026-03-27 11:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6fa5728-227f-5472-97d4-e131b884a993 with scrape type 2
2026-03-27 11:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6fa5728-227f-5472-97d4-e131b884a993, identifier: FK29667
2026-03-27 11:39:06 [scrapy.extensions.logstats] INFO: Crawled 116 pages (at 2 pages/min), scraped 213 items (at 24 items/min)
2026-03-27 11:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-27 11:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-27 11:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667
2026-03-27 11:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6fa5728-227f-5472-97d4-e131b884a993 with identifier: FK29667 to the API
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:45:15Z',
 'fuel_type': 'diesel',
 'id': 'b6fa5728-227f-5472-97d4-e131b884a993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29667',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 164568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Pritsche 50 lang RWD',
 'transmission': 'manual',
 'trim': 'Pritsche 50 lang RWD',
 'year': 2020}
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-27 11:39:07 [auto1.be] INFO: Saving data for FK29667: {'auction_closing_time': 1774629915.0, 'created_time': 1774524980.883255, 'last_price_update_time': 1774611547.251243}
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK29667') HTTP/1.1" 204 0
2026-03-27 11:39:07 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK67306%27 HTTP/1.1" 200 None
2026-03-27 11:39:07 [auto1.be] INFO: Scrape type for FK67306: 0
2026-03-27 11:39:07 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-27 11:39:07 [auto1.be] INFO: Scrape type for MG81689: 2
2026-03-27 11:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-27 11:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with scrape type 2
2026-03-27 11:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with scrape type 2
2026-03-27 11:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c, identifier: MG81689
2026-03-27 11:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-27 11:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689
2026-03-27 11:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cfe4be9f-131e-5380-a3ba-1ca82ec2e80c with identifier: MG81689 to the API
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:27:55Z',
 'fuel_type': 'petrol',
 'id': 'cfe4be9f-131e-5380-a3ba-1ca82ec2e80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81689',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 114137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'Renault Clio 1.6 Night and Day',
 'transmission': 'automatic',
 'trim': 'Night and Day',
 'year': 2012}
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-27 11:39:07 [auto1.be] INFO: Saving data for MG81689: {'auction_closing_time': 1774628875.0, 'created_time': 1774524968.056158, 'last_price_update_time': 1774611547.738559}
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG81689') HTTP/1.1" 204 0
2026-03-27 11:39:07 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-27 11:39:07 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-27 11:39:07 [auto1.be] INFO: Scrape type for HW95173: 2
2026-03-27 11:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-27 11:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with scrape type 2
2026-03-27 11:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with scrape type 2
2026-03-27 11:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa, identifier: HW95173
2026-03-27 11:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-27 11:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173
2026-03-27 11:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa with identifier: HW95173 to the API
2026-03-27 11:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:42:19Z',
 'fuel_type': 'petrol',
 'id': '0ea9b0cf-d3dc-56e0-b9b1-7fb1f703c9aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW95173',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 258602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-12',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2011}
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-27 11:39:08 [auto1.be] INFO: Saving data for HW95173: {'auction_closing_time': 1774629739.0, 'created_time': 1774524987.687508, 'last_price_update_time': 1774611548.149288}
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HW95173') HTTP/1.1" 204 0
2026-03-27 11:39:08 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-27 11:39:08 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-27 11:39:08 [auto1.be] INFO: Scrape type for LY58233: 2
2026-03-27 11:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-27 11:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e38bf0c-6944-5305-b783-d2f785623c95 with scrape type 2
2026-03-27 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e38bf0c-6944-5305-b783-d2f785623c95 with scrape type 2
2026-03-27 11:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e38bf0c-6944-5305-b783-d2f785623c95, identifier: LY58233
2026-03-27 11:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-27 11:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233
2026-03-27 11:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e38bf0c-6944-5305-b783-d2f785623c95 with identifier: LY58233 to the API
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-27T16:27:04Z',
 'fuel_type': 'hybrid',
 'id': '4e38bf0c-6944-5305-b783-d2f785623c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY58233',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 190058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-27 11:39:08 [auto1.be] INFO: Saving data for LY58233: {'auction_closing_time': 1774628824.0, 'created_time': 1774524986.725315, 'last_price_update_time': 1774611548.62424}
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY58233') HTTP/1.1" 204 0
2026-03-27 11:39:08 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-27 11:39:08 [auto1.be] INFO: Scrape type for DP88518: 2
2026-03-27 11:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-27 11:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with scrape type 2
2026-03-27 11:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with scrape type 2
2026-03-27 11:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a4727c9-74d7-5a9c-bbd6-b359597c1961, identifier: DP88518
2026-03-27 11:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-27 11:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518
2026-03-27 11:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a4727c9-74d7-5a9c-bbd6-b359597c1961 with identifier: DP88518 to the API
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:44:00Z',
 'fuel_type': 'diesel',
 'id': '4a4727c9-74d7-5a9c-bbd6-b359597c1961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP88518',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 78421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2022}
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-27 11:39:09 [auto1.be] INFO: Saving data for DP88518: {'auction_closing_time': 1774629840.0, 'created_time': 1774524971.043457, 'last_price_update_time': 1774611549.139138}
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP88518') HTTP/1.1" 204 0
2026-03-27 11:39:09 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-27 11:39:09 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-27 11:39:09 [auto1.be] INFO: Scrape type for FU04844: 2
2026-03-27 11:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-27 11:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c421c59-071e-592e-a41d-dd19b15f57db with scrape type 2
2026-03-27 11:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c421c59-071e-592e-a41d-dd19b15f57db with scrape type 2
2026-03-27 11:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c421c59-071e-592e-a41d-dd19b15f57db, identifier: FU04844
2026-03-27 11:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-27 11:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844
2026-03-27 11:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c421c59-071e-592e-a41d-dd19b15f57db with identifier: FU04844 to the API
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:54:57Z',
 'fuel_type': 'petrol',
 'id': '7c421c59-071e-592e-a41d-dd19b15f57db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU04844',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 127728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 FSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-27 11:39:09 [auto1.be] INFO: Saving data for FU04844: {'auction_closing_time': 1774630497.0, 'created_time': 1774524983.175024, 'last_price_update_time': 1774611549.543731}
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FU04844') HTTP/1.1" 204 0
2026-03-27 11:39:09 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG60858%27 HTTP/1.1" 200 None
2026-03-27 11:39:09 [auto1.be] INFO: Scrape type for WG60858: 0
2026-03-27 11:39:09 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-27 11:39:09 [auto1.be] INFO: Found listing with ID: MS10113
2026-03-27 11:39:09 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-27 11:39:09 [auto1.be] INFO: Scrape type for EV46077: 2
2026-03-27 11:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-27 11:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c460296-1576-59d0-8fcf-26a714b03f68 with scrape type 2
2026-03-27 11:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c460296-1576-59d0-8fcf-26a714b03f68 with scrape type 2
2026-03-27 11:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c460296-1576-59d0-8fcf-26a714b03f68, identifier: EV46077
2026-03-27 11:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-27 11:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077
2026-03-27 11:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c460296-1576-59d0-8fcf-26a714b03f68 with identifier: EV46077 to the API
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:24:34Z',
 'fuel_type': 'petrol',
 'id': '4c460296-1576-59d0-8fcf-26a714b03f68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV46077',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-27 11:39:09 [auto1.be] INFO: Saving data for EV46077: {'auction_closing_time': 1774628674.0, 'created_time': 1774524991.51853, 'last_price_update_time': 1774611549.998165}
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV46077') HTTP/1.1" 204 0
2026-03-27 11:39:10 [auto1.be] INFO: Found listing with ID: BP83172
2026-03-27 11:39:10 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-27 11:39:10 [auto1.be] INFO: Scrape type for GR79063: 2
2026-03-27 11:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-27 11:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0faee88b-dade-52f1-934c-ab2f9f671d2b with scrape type 2
2026-03-27 11:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0faee88b-dade-52f1-934c-ab2f9f671d2b with scrape type 2
2026-03-27 11:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0faee88b-dade-52f1-934c-ab2f9f671d2b, identifier: GR79063
2026-03-27 11:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-27 11:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063
2026-03-27 11:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0faee88b-dade-52f1-934c-ab2f9f671d2b with identifier: GR79063 to the API
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:00:33Z',
 'fuel_type': 'diesel',
 'id': '0faee88b-dade-52f1-934c-ab2f9f671d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR79063',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 141474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-19',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Business Eco2',
 'transmission': 'manual',
 'trim': 'Business Eco2',
 'year': 2015}
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-27 11:39:10 [auto1.be] INFO: Saving data for GR79063: {'auction_closing_time': 1774627233.0, 'created_time': 1774524980.412381, 'last_price_update_time': 1774611550.401606}
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR79063') HTTP/1.1" 204 0
2026-03-27 11:39:10 [auto1.be] INFO: Channel: 24h | Page: 45 | totalHits: 1873 | hits on page: 40
2026-03-27 11:39:10 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-27 11:39:10 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-27 11:39:10 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-27 11:39:10 [auto1.be] INFO: Scrape type for BP38818: 2
2026-03-27 11:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-27 11:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with scrape type 2
2026-03-27 11:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with scrape type 2
2026-03-27 11:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75, identifier: BP38818
2026-03-27 11:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-27 11:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818
2026-03-27 11:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4b9a3fff-8724-56ad-aedb-5f4bbe542c75 with identifier: BP38818 to the API
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:34:06Z',
 'fuel_type': 'petrol',
 'id': '4b9a3fff-8724-56ad-aedb-5f4bbe542c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP38818',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 147831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-27 11:39:10 [auto1.be] INFO: Saving data for BP38818: {'auction_closing_time': 1774629246.0, 'created_time': 1774524988.58517, 'last_price_update_time': 1774611550.968896}
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP38818') HTTP/1.1" 204 0
2026-03-27 11:39:10 [auto1.be] INFO: Found listing with ID: ZK72697
2026-03-27 11:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK72697%27 HTTP/1.1" 200 None
2026-03-27 11:39:11 [auto1.be] INFO: Scrape type for ZK72697: 2
2026-03-27 11:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0592e7d4-292f-5511-b5c4-4e12c3c83041 with identifier: ZK72697
2026-03-27 11:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0592e7d4-292f-5511-b5c4-4e12c3c83041 with scrape type 2
2026-03-27 11:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0592e7d4-292f-5511-b5c4-4e12c3c83041 with scrape type 2
2026-03-27 11:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0592e7d4-292f-5511-b5c4-4e12c3c83041, identifier: ZK72697
2026-03-27 11:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:39:11 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-27 11:39:11 [auto1.be] INFO: Scrape type for ZJ76170: 2
2026-03-27 11:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-27 11:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with scrape type 2
2026-03-27 11:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with scrape type 2
2026-03-27 11:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e, identifier: ZJ76170
2026-03-27 11:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0592e7d4-292f-5511-b5c4-4e12c3c83041 with identifier: ZK72697
2026-03-27 11:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0592e7d4-292f-5511-b5c4-4e12c3c83041 with identifier: ZK72697
2026-03-27 11:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0592e7d4-292f-5511-b5c4-4e12c3c83041 with identifier: ZK72697 to the API
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-27T16:40:34Z',
 'fuel_type': 'petrol',
 'id': '0592e7d4-292f-5511-b5c4-4e12c3c83041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK72697',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 66676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-23',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK72697%27 HTTP/1.1" 200 None
2026-03-27 11:39:11 [auto1.be] INFO: Saving data for ZK72697: {'auction_closing_time': 1774629634.0, 'created_time': 1774524978.386393, 'last_price_update_time': 1774611551.55507}
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZK72697') HTTP/1.1" 204 0
2026-03-27 11:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-27 11:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170
2026-03-27 11:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e with identifier: ZJ76170 to the API
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:43:09Z',
 'fuel_type': 'petrol',
 'id': '98b70a10-bf0b-59d1-bc53-b9b03cb8ec4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ76170',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 122576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-27 11:39:11 [auto1.be] INFO: Saving data for ZJ76170: {'auction_closing_time': 1774629789.0, 'created_time': 1774524964.609558, 'last_price_update_time': 1774611551.990546}
2026-03-27 11:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ76170') HTTP/1.1" 204 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: GF77372
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for HZ19238: 2
2026-03-27 11:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-27 11:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with scrape type 2
2026-03-27 11:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with scrape type 2
2026-03-27 11:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4ec37d8-52a1-5835-98e4-ea91f3cfd042, identifier: HZ19238
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for ML35155: 2
2026-03-27 11:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-27 11:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27431265-39ba-5c53-a9c2-ee1d17379273 with scrape type 2
2026-03-27 11:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27431265-39ba-5c53-a9c2-ee1d17379273 with scrape type 2
2026-03-27 11:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27431265-39ba-5c53-a9c2-ee1d17379273, identifier: ML35155
2026-03-27 11:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-27 11:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238
2026-03-27 11:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4ec37d8-52a1-5835-98e4-ea91f3cfd042 with identifier: HZ19238 to the API
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:07:56Z',
 'fuel_type': 'diesel',
 'id': 'e4ec37d8-52a1-5835-98e4-ea91f3cfd042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ19238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 182429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Saving data for HZ19238: {'auction_closing_time': 1774627676.0, 'created_time': 1774524979.197727, 'last_price_update_time': 1774611552.47877}
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HZ19238') HTTP/1.1" 204 0
2026-03-27 11:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-27 11:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155
2026-03-27 11:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27431265-39ba-5c53-a9c2-ee1d17379273 with identifier: ML35155 to the API
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 11:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:45:30Z',
 'fuel_type': 'diesel',
 'id': '27431265-39ba-5c53-a9c2-ee1d17379273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML35155',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 259006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Saving data for ML35155: {'auction_closing_time': 1774629930.0, 'created_time': 1774524991.884173, 'last_price_update_time': 1774611552.754732}
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML35155') HTTP/1.1" 204 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: NS58610
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS58610%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for NS58610: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: SX47012
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: BN70432
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN70432%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for BN70432: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49722%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for TE49722: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ92859%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for SJ92859: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: UR29395
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR29395%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for UR29395: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: AV51049
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB18331%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for GB18331: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: WV50060
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV50060%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for WV50060: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: XZ93211
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ93211%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for XZ93211: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP41015%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for NP41015: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-27 11:39:12 [auto1.be] INFO: Scrape type for FV41606: 0
2026-03-27 11:39:12 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-27 11:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP97194%27 HTTP/1.1" 200 None
2026-03-27 11:39:13 [auto1.be] INFO: Scrape type for AP97194: 0
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-27 11:39:13 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: XE54467
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE54467%27 HTTP/1.1" 200 None
2026-03-27 11:39:13 [auto1.be] INFO: Scrape type for XE54467: 0
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF91319%27 HTTP/1.1" 200 None
2026-03-27 11:39:13 [auto1.be] INFO: Scrape type for TF91319: 0
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: KL13323
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL13323%27 HTTP/1.1" 200 None
2026-03-27 11:39:13 [auto1.be] INFO: Scrape type for KL13323: 0
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-27 11:39:13 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-27 11:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:39:14 [auto1.be] INFO: Channel: 24h | Page: 46 | totalHits: 1874 | hits on page: 40
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: KL13323
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL13323%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for KL13323: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN69845%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for AN69845: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for MJ01257: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: WG25142
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT82149%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for LT82149: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: ER55137
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER55137%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for ER55137: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT24920%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for GT24920: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW87029%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for GW87029: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: EY13692
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY13692%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for EY13692: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ21578%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for KZ21578: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD92482%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for MD92482: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: WM16539
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM16539%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for WM16539: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY97185%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for TY97185: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-27 11:39:14 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-27 11:39:14 [auto1.be] INFO: Found listing with ID: HZ61170
2026-03-27 11:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:39:15 [auto1.be] INFO: Channel: 24h | Page: 47 | totalHits: 1874 | hits on page: 34
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL30706%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for VL30706: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF21497%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for HF21497: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ63633%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for EJ63633: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF59002%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for GF59002: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX26323%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for AX26323: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: GX63977
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: VR03629
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: PP06553
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP06553%27 HTTP/1.1" 200 None
2026-03-27 11:39:15 [auto1.be] INFO: Scrape type for PP06553: 0
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-27 11:39:15 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-27 11:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GE86423%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for GE86423: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ44217%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for WZ44217: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW35122%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for YW35122: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR60731%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for RR60731: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: LX24377
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX24377%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for LX24377: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for PB88221: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW54495%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for KW54495: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH51844%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for BH51844: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: UW31030
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW31030%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for UW31030: 0
2026-03-27 11:39:16 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 11:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-27 11:39:16 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-27 11:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 11:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 11:39:17 [auto1.be] INFO: Channel: 24h | Page: 48 | totalHits: 1874 | hits on page: 0
2026-03-27 11:39:17 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 11:39:17 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-27 11:39:17 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 5, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 59, <ScrapeType.BATCH_SKIPPED: 5>: 59}
2026-03-27 11:39:17 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (226 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-27T11_35_00.jl
2026-03-27 11:39:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 616589,
 'downloader/request_count': 340,
 'downloader/request_method_count/GET': 290,
 'downloader/request_method_count/POST': 50,
 'downloader/response_bytes': 106688775,
 'downloader/response_count': 340,
 'downloader/response_status_count/200': 340,
 'dupefilter/filtered': 13,
 'elapsed_time_seconds': 250.53409,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 11, 39, 17, 271334, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 226,
 'log_count/DEBUG': 5477,
 'log_count/INFO': 6423,
 'memusage/max': 193568768,
 'memusage/startup': 149827584,
 'photo_download_count': 220,
 'request_depth_max': 51,
 'response_received_count': 120,
 'scheduler/dequeued': 340,
 'scheduler/dequeued/memory': 340,
 'scheduler/enqueued': 340,
 'scheduler/enqueued/memory': 340,
 'scrape_type/batch_skipped': 1000,
 'scrape_type/new': 34,
 'scrape_type/price_update': 192,
 'scrape_type/skipped': 675,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 120,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.01707848349664,
 'scrapy-zyte-api/mean_response_seconds': 4.082454369248202,
 'scrapy-zyte-api/processed': 120,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 120,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 119,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 120,
 'scrapy-zyte-api/request_args/httpRequestBody': 50,
 'scrapy-zyte-api/request_args/httpRequestMethod': 50,
 'scrapy-zyte-api/request_args/httpResponseBody': 120,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 120,
 'scrapy-zyte-api/request_args/sessionContext': 120,
 'scrapy-zyte-api/request_args/url': 120,
 'scrapy-zyte-api/status_codes/200': 120,
 'scrapy-zyte-api/success': 120,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1914,
 'source/total_available': 1874,
 'start_time': datetime.datetime(2026, 3, 27, 11, 35, 6, 737244, tzinfo=datetime.timezone.utc)}
2026-03-27 11:39:17 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 11:39:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f134f93a550>
2026-03-27 11:39:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f134fa8c250>